Apr 15 10:03:53 devstack cinder-volume[73075]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:03:53 devstack cinder-volume[73075]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:03:53 devstack cinder-volume[73075]: we strongly recommend against using it for new projects. Apr 15 10:03:53 devstack cinder-volume[73075]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:03:53 devstack cinder-volume[73075]: framework. For more detail see Apr 15 10:03:53 devstack cinder-volume[73075]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:03:53 devstack cinder-volume[73075]: import eventlet # noqa Apr 15 10:03:54 devstack cinder-volume[73075]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:03:54 devstack cinder-volume[73075]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:03:54 devstack cinder-volume[73075]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:03:55 devstack cinder-volume[73075]: INFO dbcounter [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Registered counter for database cinder Apr 15 10:03:55 devstack cinder-volume[73075]: DEBUG oslo_db.sqlalchemy.engines [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:03:55 devstack cinder-volume[73075]: DEBUG dbcounter [-] [73075] Writer thread running {{(pid=73075) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:03:55 devstack cinder-volume[73075]: INFO cinder.rpc [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:03:55 devstack cinder-volume[73075]: INFO cinder.rpc [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:03:55 devstack cinder-volume[73075]: DEBUG oslo_db.sqlalchemy.engines [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:03:55 devstack cinder-volume[73075]: INFO cinder.volume.manager [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Determined volume DB was empty at startup. Apr 15 10:03:55 devstack cinder-volume[73075]: DEBUG cinder.volume.manager [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73075) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:03:55 devstack cinder-volume[73075]: INFO cinder.volume.manager [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 10:03:55 devstack cinder-volume[73075]: WARNING stevedore.named [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:03:55 devstack cinder-volume[73075]: WARNING castellan.key_manager [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:03:55 devstack cinder-volume[73075]: WARNING cinder.keymgr.conf_key_mgr [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:03:55 devstack cinder-volume[73075]: DEBUG cinder.volume.drivers.lvm [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73075) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 10:03:55 devstack cinder-volume[73075]: DEBUG oslo_concurrency.processutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_concurrency.processutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.275s {{(pid=73075) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_db.sqlalchemy.engines [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:03:56 devstack cinder-volume[73075]: INFO cinder.rpc [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 10:03:56 devstack cinder-volume[73075]: INFO cinder.rpc [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 10:03:56 devstack cinder-volume[73075]: WARNING stevedore.named [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:03:56 devstack cinder-volume[73075]: WARNING castellan.key_manager [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:03:56 devstack cinder-volume[73075]: INFO cinder.volume.manager [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_db.sqlalchemy.engines [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:03:56 devstack cinder-volume[73075]: INFO oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Starting 1 workers Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Started child 73179 {{(pid=73075) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Full set of CONF: {{(pid=73075) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] ******************************************************************************** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Configuration options gathered from: {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] ================================================================================ {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] allow_availability_zone_fallback = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] allow_compression_on_image_upload = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] allowed_direct_url_schemes = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] api_rate_limit = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] auth_strategy = keystone {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] az_cache_duration = 3600 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_availability_zone = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_host = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_stats_polling_interval = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backup_api_class = cinder.backup.api.API {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backup_name_template = backup-%s {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backup_use_same_host = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backup_use_temp_snapshot = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] chap_password = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] chap_username = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_internal_tenant_project_id = 374d65ba9384407383d2385576ecf16d {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_internal_tenant_user_id = f90acb0fdfc143b8b607bf1e90e83902 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cloned_volume_same_az = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cluster = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] compression_format = gzip {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] compute_api_class = cinder.compute.nova.API {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] config_dir = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73179]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] config_source = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] control_exchange = openstack {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] debug = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] default_availability_zone = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] default_group_type = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] default_volume_type = lvmdriver-1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] disk_geometry = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] driver_client_cert = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] driver_client_cert_key = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] driver_data_namespace = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] driver_ssl_cert_path = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] driver_ssl_cert_verify = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] driver_use_ssl = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] enable_force_upload = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] enable_new_services = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] enable_unsupported_driver = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] enforce_multipath_for_image_xfer = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] filter_function = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_api_insecure = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_api_servers = ['http://192.168.122.131/image'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_api_ssl_compression = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_ca_certificates_file = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_catalog_info = image:glance:publicURL {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_num_retries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance_request_timeout = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] goodness_function = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] graceful_shutdown_timeout = 5 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] group_api_class = cinder.group.api.API {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] host = devstack {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_compress_on_upload = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_conversion_address_space_limit = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_conversion_cpu_limit = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_conversion_disable = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_upload_use_cinder_backend = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_upload_use_internal_tenant = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_volume_cache_enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_volume_cache_max_count = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] image_volume_cache_max_size_gb = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] init_host_max_objects_retrieval = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] instance_format = [instance: %(uuid)s] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] iscsi_target_flags = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] iscsi_write_cache = on {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] iser_helper = tgtadm {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] iser_ip_address = 192.168.122.131 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] iser_port = 3260 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_color = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_config_append = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_dir = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_file = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_options = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_rotate_interval = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_rotate_interval_type = days {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] log_rotation_type = none {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] max_age = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] max_logfile_count = 30 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] max_logfile_size_mb = 200 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] max_over_subscription_ratio = 20.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] message_reap_interval = 86400 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] message_ttl = 2592000 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] migration_create_volume_timeout_secs = 300 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73179]: INFO cinder.volume.manager [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] monkey_patch = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] monkey_patch_modules = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] my_ip = 192.168.122.131 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] no_snapshot_gb_quota = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] num_iser_scan_tries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] num_shell_tries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] num_volume_device_scan_tries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] nvmeof_conn_info_version = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] nvmet_ns_id = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] nvmet_port_id = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] osapi_max_limit = 1000 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] osapi_volume_ext_list = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] osapi_volume_listen_port = 8776 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] osapi_volume_use_ssl = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] osapi_volume_workers = 2 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] per_volume_size_limit = -1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] periodic_fuzzy_delay = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] periodic_interval = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] public_endpoint = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] publish_errors = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] quota_backup_gigabytes = 1000 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] quota_backups = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] quota_gigabytes = 1000 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] quota_groups = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] quota_snapshots = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] quota_volumes = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] rate_limit_burst = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] rate_limit_except_level = CRITICAL {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] rate_limit_interval = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] reinit_driver_count = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] replication_device = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] report_discard_supported = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] report_interval = 120 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] reservation_clean_interval = 86400 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] reservation_expire = 86400 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] reserved_image_namespaces = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] reserved_percentage = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] rpc_response_timeout = 120 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] run_external_periodic_tasks = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] scst_target_driver = iscsi {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] scst_target_iqn_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_down_time = 720 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] shell_completion = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] snapshot_name_template = snapshot-%s {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] snapshot_same_host = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] split_loggers = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] state_path = /opt/stack/data/cinder {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] storage_availability_zone = nova {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] storage_protocol = iSCSI {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] syslog_log_facility = LOG_USER {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] target_helper = lioadm {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] target_ip_address = 192.168.122.131 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] target_port = 3260 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] target_protocol = iscsi {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] target_secondary_ip_addresses = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] trace_flags = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] transport_url = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] until_refresh = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] use_chap_auth = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] use_default_quota_class = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] use_journal = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] use_json = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] use_multipath_for_image_xfer = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] use_stderr = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] use_syslog = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] verify_glance_signatures = enabled {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_api_class = cinder.volume.api.API {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_backend_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_clear = zero {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_clear_ionice = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_clear_size = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_copy_bps_limit = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_dd_blocksize = 1M {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_name_template = volume-%s {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_service_inithost_offload = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volume_usage_audit_period = month {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] zoning_mode = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_concurrency.disable_process_locking = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.admin_password = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.admin_token = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.admin_user = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_port = 35357 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_protocol = https {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_section = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_type = password {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_uri = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.auth_version = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.cache = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.identity_uri = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.include_service_catalog = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.insecure = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.interface = public {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_password = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcache_username = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.region_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.064s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.service_type = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.backend = dogpile.cache.null {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.backend_argument = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.backend_expiration_time = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.config_prefix = cache.oslo {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.debug_cache_backend = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.enable_retry_client = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.enable_socket_keepalive = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.enforce_fips_mode = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.expiration_time = 600 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.hashclient_retry_attempts = 2 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.memcache_dead_retry = 300 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.memcache_pool_maxsize = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.memcache_sasl_enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.password = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.proxies = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.redis_db = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.redis_server = localhost:6379 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.retry_attempts = 2 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.retry_delay = 0.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.socket_keepalive_count = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.socket_keepalive_idle = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.socket_keepalive_interval = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.socket_timeout = 1.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.tls_allowed_ciphers = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.tls_cafile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.tls_certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.tls_enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.tls_keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cache.username = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] coordination.backend_url = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.asyncio_connection = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.asyncio_slave_connection = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.backend = sqlalchemy {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.connection = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.connection_debug = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.connection_parameters = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.connection_recycle_time = 3600 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.connection_trace = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.db_inc_retry_interval = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.db_max_retries = 20 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.db_max_retry_interval = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.db_retry_interval = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.max_overflow = 50 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.max_pool_size = 5 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.max_retries = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.mysql_wsrep_sync_wait = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.pool_timeout = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.retry_interval = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.slave_connection = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.sqlite_synchronous = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.synchronous_reader = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] database.use_db_reconnect = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.connection_string = messaging:// {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.es_doc_type = notification {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.es_scroll_size = 10000 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.es_scroll_time = 2m {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.filter_error_trace = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.hmac_keys = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.sentinel_service_name = mymaster {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.socket_timeout = 0.1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.trace_requests = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler.trace_sqlalchemy = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler_jaeger.process_tags = {} {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler_jaeger.service_name_prefix = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] profiler_otlp.service_name_prefix = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.enforce_new_defaults = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: WARNING oslo_config.cfg [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.enforce_scope = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.policy_default_rule = default {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.policy_file = policy.yaml {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] privsep_osbrick.group = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] privsep_osbrick.helper_command = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] privsep_osbrick.user = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_sys_admin.group = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_sys_admin.helper_command = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] cinder_sys_admin.user = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.auth_section = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.auth_type = password {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.cafile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.collect_timing = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.insecure = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.send_service_user_token = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.split_loggers = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] service_user.timeout = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.auth_section = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.auth_type = password {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.collect_timing = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.insecure = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.region_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.split_loggers = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] glance.timeout = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.backend_availability_zone = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.chap_password = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.chap_username = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.disk_geometry = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.driver_client_cert = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.driver_client_cert_key = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.driver_data_namespace = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.driver_use_ssl = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.extra_capabilities = {} {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.filter_function = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.goodness_function = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.iscsi_target_flags = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.iscsi_write_cache = on {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.iser_helper = tgtadm {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.iser_port = 3260 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.lvm_share_target = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.lvm_type = auto {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.num_shell_tries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.replication_device = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.report_discard_supported = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.reserved_percentage = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.target_helper = tgtadm {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.target_port = 3260 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.target_protocol = iscsi {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.trace_flags = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.unique_fqdn_network = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.use_chap_auth = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_backend_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_clear = zero {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_clear_ionice = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_clear_size = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_reports.file_event_handler = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_reports.log_dir = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.backend_host = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.chap_password = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.chap_username = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.disk_geometry = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.driver_client_cert = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.066s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.extra_capabilities = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.filter_function = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.goodness_function = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.iser_helper = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.iser_ip_address = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.iser_port = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.lvm_share_target = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.lvm_type = auto {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.num_shell_tries = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.replication_device = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.report_discard_supported = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.reserved_percentage = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.scst_target_driver = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.storage_protocol = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.target_helper = lioadm {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.target_ip_address = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.target_port = 3260 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.trace_flags = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.use_chap_auth = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_clear = zero {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_clear_size = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] lvmdriver-1.volumes_dir = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack sudo[73183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 10:03:56 devstack sudo[73183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.ssl = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_notifications.driver = [] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_notifications.retry = -1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] key_manager.fixed_key = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.barbican_api_version = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.barbican_endpoint = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.barbican_endpoint_type = public {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.barbican_region_name = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.cafile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.collect_timing = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.insecure = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.number_of_retries = 60 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.retry_delay = 1 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.send_service_user_token = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.split_loggers = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.timeout = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.verify_ssl = True {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican.verify_ssl_path = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.auth_section = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.auth_type = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.cafile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.certfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.collect_timing = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.insecure = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.keyfile = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.split_loggers = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] barbican_service_user.timeout = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.approle_role_id = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.approle_secret_id = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.kv_mountpoint = secret {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.kv_path = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.kv_version = 2 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.namespace = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.root_token_id = **** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.ssl_ca_crt_file = None {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.timeout = 60.0 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.use_ssl = False {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:03:56 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] ******************************************************************************** {{(pid=73075) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:03:56 devstack sudo[73183]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.540s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:56 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:56 devstack sudo[73187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:03:56 devstack sudo[73187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:57 devstack sudo[73187]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:57 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.593s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:57 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:03:57 devstack cinder-volume[73179]: INFO cinder.brick.local_dev.lvm [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 10:03:57 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:57 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:57 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:57 devstack sudo[73413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:03:57 devstack sudo[73413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:58 devstack sudo[73413]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:58 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:58 devstack cinder-volume[73179]: DEBUG cinder.brick.local_dev.lvm [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73179) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 10:03:58 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:58 devstack sudo[73637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:03:58 devstack sudo[73637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:58 devstack sudo[73637]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:58 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.807s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:58 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:58 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:58 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:58 devstack sudo[73783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:03:58 devstack sudo[73783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:59 devstack sudo[73783]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:59 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.594s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:59 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:59 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:59 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:59 devstack sudo[73875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 10:03:59 devstack sudo[73875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:00 devstack sudo[73875]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:00 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.523s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:00 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:00 devstack sudo[73878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:04:00 devstack sudo[73878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:00 devstack sudo[73878]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:00 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:00 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:00 devstack sudo[73881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:04:00 devstack sudo[73881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:01 devstack sudo[73881]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:01 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.537s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:01 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:01 devstack sudo[73888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:01 devstack sudo[73888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:01 devstack sudo[73888]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:01 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:01 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:01 devstack sudo[73896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:01 devstack sudo[73896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:02 devstack sudo[73896]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:02 devstack sudo[73901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:02 devstack sudo[73901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:02 devstack sudo[73901]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:02 devstack cinder-volume[73179]: INFO cinder.volume.drivers.lvm [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:02 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:02 devstack sudo[73909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:02 devstack sudo[73909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:03 devstack sudo[73909]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:03 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:03 devstack cinder-volume[73179]: DEBUG cinder.volume.drivers.lvm [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Updating volume stats {{(pid=73179) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:04:03 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:03 devstack sudo[74024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:04:03 devstack sudo[74024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:03 devstack sudo[74024]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:03 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:03 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:03 devstack sudo[74076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:03 devstack sudo[74076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:04 devstack sudo[74076]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:04 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:04 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:04 devstack sudo[74168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:04 devstack sudo[74168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:04 devstack sudo[74168]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:04 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:04 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:04 devstack sudo[74172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:04 devstack sudo[74172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:05 devstack sudo[74172]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:05 devstack cinder-volume[73179]: INFO cinder.volume.driver [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG cinder.volume.driver [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73179) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG oslo_db.sqlalchemy.engines [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG dbcounter [-] [73179] Writer thread running {{(pid=73179) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG cinder.db.sqlalchemy.api [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Building query based on filter {{(pid=73179) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG cinder.image.image_utils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73179) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:04:05 devstack cinder-volume[73179]: INFO cinder.keymgr.migration [None req-92c43211-0072-4f60-a641-0f5a00c1871e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG cinder.volume.drivers.lvm [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Updating volume stats {{(pid=73179) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:05 devstack sudo[74176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:04:05 devstack sudo[74176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:05 devstack sudo[74176]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:05 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:05 devstack sudo[74182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:05 devstack sudo[74182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:06 devstack cinder-volume[73075]: DEBUG dbcounter [-] [73075] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73075) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:04:06 devstack sudo[74182]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:06 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:06 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:06 devstack sudo[74187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:06 devstack sudo[74187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:06 devstack sudo[74187]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:06 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.511s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:06 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:06 devstack sudo[74191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:06 devstack sudo[74191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:07 devstack sudo[74191]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.542s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG cinder.manager [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Notifying Schedulers of capabilities ... {{(pid=73179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:04:07 devstack cinder-volume[73179]: INFO cinder.volume.manager [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Driver initialization completed successfully. Apr 15 10:04:07 devstack cinder-volume[73179]: INFO cinder.manager [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Initiating service 2 cleanup Apr 15 10:04:07 devstack cinder-volume[73179]: INFO cinder.manager [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Service 2 cleanup completed. Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG cinder.service [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Creating RPC server for service cinder-volume {{(pid=73179) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG cinder.service [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73179) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:04:07 devstack cinder-volume[73179]: INFO cinder.volume.manager [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG cinder.volume.drivers.lvm [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Updating volume stats {{(pid=73179) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:07 devstack sudo[74196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:04:07 devstack sudo[74196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:07 devstack sudo[74196]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.565s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:07 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:08 devstack sudo[74202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:08 devstack sudo[74202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:08 devstack sudo[74202]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:08 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:08 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:08 devstack sudo[74259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:08 devstack sudo[74259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:08 devstack sudo[74259]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:08 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:08 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:08 devstack sudo[74262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:08 devstack sudo[74262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:09 devstack sudo[74262]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:09 devstack cinder-volume[73179]: INFO cinder.volume.manager [None req-20dd46f5-6937-42a7-a447-cb902e31a9ab None None] Driver post RPC initialization completed successfully. Apr 15 10:04:19 devstack cinder-volume[73179]: DEBUG dbcounter [-] [73179] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73179) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:04:19 devstack cinder-volume[73179]: DEBUG dbcounter [-] [73179] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73179) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:05:09 devstack cinder-volume[73179]: DEBUG oslo_service.periodic_task [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73179) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:05:09 devstack cinder-volume[73179]: DEBUG cinder.volume.drivers.lvm [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Updating volume stats {{(pid=73179) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:05:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:09 devstack sudo[78572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:05:09 devstack sudo[78572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:05:09 devstack sudo[78572]: pam_unix(sudo:session): session closed for user root Apr 15 10:05:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:09 devstack sudo[78951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:05:09 devstack sudo[78951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:05:10 devstack sudo[78951]: pam_unix(sudo:session): session closed for user root Apr 15 10:05:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:10 devstack sudo[78994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:05:10 devstack sudo[78994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:05:10 devstack sudo[78994]: pam_unix(sudo:session): session closed for user root Apr 15 10:05:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:05:11 devstack sudo[79001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:05:11 devstack sudo[79001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:05:11 devstack sudo[79001]: pam_unix(sudo:session): session closed for user root Apr 15 10:05:11 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:05:11 devstack cinder-volume[73179]: DEBUG cinder.manager [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Notifying Schedulers of capabilities ... {{(pid=73179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:09 devstack cinder-volume[73179]: DEBUG oslo_service.periodic_task [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73179) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:06:09 devstack cinder-volume[73179]: DEBUG cinder.volume.drivers.lvm [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Updating volume stats {{(pid=73179) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:06:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:09 devstack sudo[79371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:06:09 devstack sudo[79371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:09 devstack sudo[79371]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:09 devstack sudo[79375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:06:09 devstack sudo[79375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:10 devstack sudo[79375]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:10 devstack sudo[79383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:06:10 devstack sudo[79383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:10 devstack sudo[79383]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:10 devstack sudo[79386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:06:10 devstack sudo[79386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:11 devstack sudo[79386]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:11 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:11 devstack cinder-volume[73179]: DEBUG cinder.manager [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Notifying Schedulers of capabilities ... {{(pid=73179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:19 devstack cinder-volume[73179]: DEBUG dbcounter [-] [73179] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73179) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:07:09 devstack cinder-volume[73179]: DEBUG oslo_service.periodic_task [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73179) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:07:09 devstack cinder-volume[73179]: DEBUG cinder.volume.drivers.lvm [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Updating volume stats {{(pid=73179) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:07:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:09 devstack sudo[81431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:07:09 devstack sudo[81431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:09 devstack sudo[81431]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:09 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:09 devstack sudo[81435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:07:09 devstack sudo[81435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:10 devstack sudo[81435]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:10 devstack sudo[81461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:07:10 devstack sudo[81461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:10 devstack sudo[81461]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:10 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:10 devstack sudo[81467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:07:10 devstack sudo[81467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:11 devstack sudo[81467]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:11 devstack cinder-volume[73179]: DEBUG oslo_concurrency.processutils [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=73179) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:11 devstack cinder-volume[73179]: DEBUG cinder.manager [None req-06308a7d-fbd6-4037-8bb3-52aa5d98605e None None] Notifying Schedulers of capabilities ... {{(pid=73179) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:47 devstack cinder-volume[73075]: INFO oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Caught SIGTERM, stopping children Apr 15 10:07:47 devstack cinder-volume[73075]: DEBUG oslo_concurrency.lockutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Acquiring lock "singleton_lock" {{(pid=73075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:07:47 devstack cinder-volume[73075]: DEBUG oslo_concurrency.lockutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Acquired lock "singleton_lock" {{(pid=73075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:07:47 devstack cinder-volume[73075]: DEBUG oslo_concurrency.lockutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Releasing lock "singleton_lock" {{(pid=73075) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:07:47 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Stop services. {{(pid=73075) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 10:07:47 devstack cinder-volume[73075]: DEBUG oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Killing children. {{(pid=73075) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 10:07:47 devstack cinder-volume[73075]: INFO oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Waiting on 1 children to exit Apr 15 10:07:52 devstack cinder-volume[73179]: DEBUG oslo_concurrency.lockutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Acquiring lock "singleton_lock" {{(pid=73179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:07:52 devstack cinder-volume[73179]: DEBUG oslo_concurrency.lockutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Acquired lock "singleton_lock" {{(pid=73179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:07:52 devstack cinder-volume[73179]: DEBUG oslo_concurrency.lockutils [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Releasing lock "singleton_lock" {{(pid=73179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:07:52 devstack cinder-volume[73179]: WARNING amqp [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:07:52 devstack cinder-volume[73179]: WARNING amqp [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:07:52 devstack cinder-volume[73075]: INFO oslo_service.backend._eventlet.service [None req-ce40e580-6b57-49bd-9cf6-ac3958c0edc5 None None] Child 73179 exited with status 0 Apr 15 10:07:52 devstack cinder-volume[82290]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:07:52 devstack cinder-volume[82290]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:07:52 devstack cinder-volume[82290]: we strongly recommend against using it for new projects. Apr 15 10:07:52 devstack cinder-volume[82290]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:07:52 devstack cinder-volume[82290]: framework. For more detail see Apr 15 10:07:52 devstack cinder-volume[82290]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:07:52 devstack cinder-volume[82290]: import eventlet # noqa Apr 15 10:07:54 devstack cinder-volume[82290]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:07:54 devstack cinder-volume[82290]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:07:54 devstack cinder-volume[82290]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:07:55 devstack cinder-volume[82290]: INFO dbcounter [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Registered counter for database cinder Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_db.sqlalchemy.engines [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG dbcounter [-] [82290] Writer thread running {{(pid=82290) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:07:55 devstack cinder-volume[82290]: INFO cinder.rpc [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:07:55 devstack cinder-volume[82290]: INFO cinder.rpc [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_db.sqlalchemy.engines [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:07:55 devstack cinder-volume[82290]: INFO cinder.volume.manager [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Determined volume DB was empty at startup. Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG cinder.volume.manager [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82290) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:07:55 devstack cinder-volume[82290]: INFO cinder.volume.manager [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 10:07:55 devstack cinder-volume[82290]: WARNING stevedore.named [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:07:55 devstack cinder-volume[82290]: WARNING castellan.key_manager [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:07:55 devstack cinder-volume[82290]: WARNING cinder.keymgr.conf_key_mgr [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:07:55 devstack cinder-volume[82290]: INFO cinder.volume.manager [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_db.sqlalchemy.engines [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82290) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:07:55 devstack cinder-volume[82290]: INFO oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Starting 1 workers Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Started child 82407 {{(pid=82290) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Full set of CONF: {{(pid=82290) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] ******************************************************************************** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Configuration options gathered from: {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] ================================================================================ {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] allow_availability_zone_fallback = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] allow_compression_on_image_upload = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82407]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] allowed_direct_url_schemes = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] api_rate_limit = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] auth_strategy = keystone {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_availability_zone = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_host = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_stats_polling_interval = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backup_api_class = cinder.backup.api.API {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backup_name_template = backup-%s {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backup_use_same_host = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backup_use_temp_snapshot = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] chap_password = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] chap_username = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_internal_tenant_project_id = 374d65ba9384407383d2385576ecf16d {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_internal_tenant_user_id = f90acb0fdfc143b8b607bf1e90e83902 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cluster = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] compression_format = gzip {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] compute_api_class = cinder.compute.nova.API {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] config_dir = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] config_source = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] control_exchange = openstack {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] debug = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] default_availability_zone = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] default_group_type = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] default_volume_type = QuobyteHD {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] disk_geometry = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] driver_client_cert = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] driver_client_cert_key = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] driver_data_namespace = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] driver_ssl_cert_path = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] driver_ssl_cert_verify = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] driver_use_ssl = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] enable_new_services = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] enable_unsupported_driver = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] enabled_backends = ['QuobyteHD'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] enforce_multipath_for_image_xfer = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] filter_function = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_api_insecure = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_api_servers = ['http://192.168.122.131/image'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_api_ssl_compression = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_ca_certificates_file = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_catalog_info = image:glance:publicURL {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_num_retries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance_request_timeout = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] goodness_function = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] graceful_shutdown_timeout = 5 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] group_api_class = cinder.group.api.API {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] host = devstack {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_compress_on_upload = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_conversion_address_space_limit = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_conversion_cpu_limit = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_conversion_disable = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_upload_use_cinder_backend = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_upload_use_internal_tenant = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_volume_cache_enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_volume_cache_max_count = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] image_volume_cache_max_size_gb = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] init_host_max_objects_retrieval = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] instance_format = [instance: %(uuid)s] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] iscsi_target_flags = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] iscsi_write_cache = on {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] iser_helper = tgtadm {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] iser_ip_address = 192.168.122.131 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] iser_port = 3260 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_color = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_config_append = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_dir = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_file = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_options = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_rotate_interval = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_rotate_interval_type = days {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] log_rotation_type = none {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] max_age = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] max_logfile_count = 30 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] max_logfile_size_mb = 200 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] max_over_subscription_ratio = 20.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] message_reap_interval = 86400 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] message_ttl = 2592000 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] migration_create_volume_timeout_secs = 300 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] monkey_patch = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] monkey_patch_modules = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] my_ip = 192.168.122.131 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] no_snapshot_gb_quota = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] num_iser_scan_tries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] num_shell_tries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] num_volume_device_scan_tries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] nvmeof_conn_info_version = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] nvmet_ns_id = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] nvmet_port_id = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] osapi_max_limit = 1000 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] osapi_volume_ext_list = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] osapi_volume_listen_port = 8776 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] osapi_volume_use_ssl = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] osapi_volume_workers = 2 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] per_volume_size_limit = -1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] periodic_fuzzy_delay = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] periodic_interval = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] public_endpoint = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] publish_errors = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] quota_backup_gigabytes = 1000 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] quota_backups = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] quota_gigabytes = 1000 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] quota_groups = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] quota_snapshots = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] quota_volumes = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] rate_limit_burst = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] rate_limit_except_level = CRITICAL {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] rate_limit_interval = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] reinit_driver_count = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] replication_device = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] report_discard_supported = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82407]: INFO cinder.volume.manager [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] report_interval = 120 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.remotefs [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82407) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] reservation_clean_interval = 86400 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] reservation_expire = 86400 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] reserved_image_namespaces = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] reserved_percentage = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] rpc_response_timeout = 120 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] run_external_periodic_tasks = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] scst_target_driver = iscsi {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] scst_target_iqn_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_down_time = 720 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] shell_completion = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] snapshot_name_template = snapshot-%s {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] split_loggers = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] state_path = /opt/stack/data/cinder {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] storage_availability_zone = nova {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] storage_protocol = iSCSI {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] syslog_log_facility = LOG_USER {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] target_helper = lioadm {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] target_ip_address = 192.168.122.131 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] target_port = 3260 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] target_protocol = iscsi {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] target_secondary_ip_addresses = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] trace_flags = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] transport_url = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] until_refresh = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] use_chap_auth = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] use_default_quota_class = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] use_journal = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] use_json = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] use_multipath_for_image_xfer = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] use_stderr = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] use_syslog = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] verify_glance_signatures = enabled {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_api_class = cinder.volume.api.API {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_backend_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_clear = zero {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_clear_ionice = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_clear_size = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_copy_bps_limit = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_dd_blocksize = 1M {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_name_template = volume-%s {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_service_inithost_offload = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volume_usage_audit_period = month {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] zoning_mode = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_concurrency.disable_process_locking = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.admin_password = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.admin_token = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.admin_user = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_port = 35357 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_protocol = https {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_section = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_type = password {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_uri = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.auth_version = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.cache = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.identity_uri = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.include_service_catalog = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.insecure = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.interface = public {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_password = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcache_username = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.region_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.service_type = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.backend = dogpile.cache.null {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.backend_argument = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.backend_expiration_time = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.config_prefix = cache.oslo {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.debug_cache_backend = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.enable_retry_client = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.enable_socket_keepalive = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.enforce_fips_mode = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.expiration_time = 600 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.hashclient_retry_attempts = 2 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.memcache_dead_retry = 300 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.memcache_pool_maxsize = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.memcache_sasl_enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.password = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.proxies = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.redis_db = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.redis_server = localhost:6379 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.retry_attempts = 2 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.retry_delay = 0.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.socket_keepalive_count = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.socket_keepalive_idle = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.socket_keepalive_interval = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.socket_timeout = 1.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.tls_allowed_ciphers = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.tls_cafile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.tls_certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.tls_enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.tls_keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cache.username = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] coordination.backend_url = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.asyncio_connection = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.asyncio_slave_connection = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.backend = sqlalchemy {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.connection = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.connection_debug = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.connection_parameters = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.connection_recycle_time = 3600 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.connection_trace = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.db_inc_retry_interval = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.db_max_retries = 20 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.db_max_retry_interval = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.db_retry_interval = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.max_overflow = 50 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.max_pool_size = 5 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.max_retries = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.mysql_wsrep_sync_wait = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.pool_timeout = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.retry_interval = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.slave_connection = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.sqlite_synchronous = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.synchronous_reader = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] database.use_db_reconnect = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.connection_string = messaging:// {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.es_doc_type = notification {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.es_scroll_size = 10000 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.es_scroll_time = 2m {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.filter_error_trace = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.hmac_keys = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.sentinel_service_name = mymaster {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.socket_timeout = 0.1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.trace_requests = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler.trace_sqlalchemy = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler_jaeger.process_tags = {} {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler_jaeger.service_name_prefix = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] profiler_otlp.service_name_prefix = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.enforce_new_defaults = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: WARNING oslo_config.cfg [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.enforce_scope = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.policy_default_rule = default {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.policy_file = policy.yaml {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] privsep_osbrick.group = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] privsep_osbrick.helper_command = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] privsep_osbrick.user = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_sys_admin.group = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_sys_admin.helper_command = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82407) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 10:07:55 devstack cinder-volume[82407]: WARNING cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 10:07:55 devstack cinder-volume[82407]: WARNING cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] cinder_sys_admin.user = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.auth_section = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.auth_type = password {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.cafile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.collect_timing = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.insecure = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.send_service_user_token = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Running cmd (subprocess): mount.quobyte {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.split_loggers = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] service_user.timeout = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.auth_section = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.auth_type = password {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.collect_timing = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.insecure = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.region_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.split_loggers = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] glance.timeout = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.backend_availability_zone = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.chap_password = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.chap_username = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.disk_geometry = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.driver_client_cert = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.driver_client_cert_key = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.driver_data_namespace = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.driver_use_ssl = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.extra_capabilities = {} {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.filter_function = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.goodness_function = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.iscsi_target_flags = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.iscsi_write_cache = on {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.iser_helper = tgtadm {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.iser_port = 3260 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_host = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_login = admin {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_mount_options = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_password = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_private_key = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_share_path = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.num_shell_tries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.quobyte_volume_url = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.replication_device = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.report_discard_supported = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.reserved_percentage = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.target_helper = tgtadm {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.target_port = 3260 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.target_protocol = iscsi {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.trace_flags = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.unique_fqdn_network = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.use_chap_auth = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_backend_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_clear = zero {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_clear_ionice = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_clear_size = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_reports.file_event_handler = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_reports.log_dir = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.backend_availability_zone = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.backend_host = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.chap_password = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.chap_username = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.chiscsi_conf = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.disk_geometry = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.driver_client_cert = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.driver_data_namespace = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.driver_use_ssl = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.extra_capabilities = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.filter_function = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.goodness_function = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.iser_helper = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.iser_ip_address = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.iser_port = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.iser_target_prefix = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_host = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_login = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_mount_options = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_password = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_private_key = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_share_path = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_ssh_port = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.num_shell_tries = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.nvmet_port_id = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.replication_device = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.report_discard_supported = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.reserved_percentage = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.scst_target_driver = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.storage_protocol = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.target_helper = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.target_ip_address = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.target_port = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.target_prefix = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.target_protocol = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.trace_flags = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.use_chap_auth = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_clear = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_clear_size = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] QuobyteHD.volumes_dir = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.ssl = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_notifications.driver = [] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_notifications.retry = -1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] key_manager.fixed_key = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.barbican_api_version = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.barbican_endpoint = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.barbican_endpoint_type = public {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.barbican_region_name = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.cafile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.collect_timing = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.insecure = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.number_of_retries = 60 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.retry_delay = 1 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.send_service_user_token = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.split_loggers = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.timeout = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.verify_ssl = True {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican.verify_ssl_path = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.auth_section = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.auth_type = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.cafile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.certfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.collect_timing = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.insecure = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.keyfile = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.split_loggers = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:55 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] barbican_service_user.timeout = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.approle_role_id = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.approle_secret_id = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.kv_mountpoint = secret {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.kv_path = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.kv_version = 2 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.namespace = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.root_token_id = **** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.ssl_ca_crt_file = None {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.timeout = 60.0 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.use_ssl = False {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:07:56 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] ******************************************************************************** {{(pid=82290) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:07:56 devstack quobyte-client[82408]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 10:07:56 devstack quobyte-client[82408]: Invalid parameters found, error: missing mount point. Apr 15 10:07:56 devstack quobyte-client[82408]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 10:07:56 devstack quobyte-client[82408]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:56 devstack cinder-volume[82407]: INFO cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 ... Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 -c /etc/quobyte/client-cinder.cfg {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:56 devstack sudo[82409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 -c /etc/quobyte/client-cinder.cfg Apr 15 10:07:56 devstack sudo[82409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:56 devstack sudo[82409]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.546s {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:56 devstack cinder-volume[82407]: INFO cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 succeeded Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.554s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:56 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:56 devstack sudo[82478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:07:56 devstack sudo[82478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:57 devstack sudo[82478]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.478s {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:57 devstack cinder-volume[82407]: INFO cinder.volume.driver [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.volume.driver [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7315406799316, 'free_capacity_gb': 1775.7315406799316, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82407) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_db.sqlalchemy.engines [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG dbcounter [-] [82407] Writer thread running {{(pid=82407) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.db.sqlalchemy.api [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Building query based on filter {{(pid=82407) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.image.image_utils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82407) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:07:57 devstack cinder-volume[82407]: INFO cinder.keymgr.migration [None req-a8d3304a-43e7-4247-b40d-04468ac2fbdb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:57 devstack sudo[82481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:07:57 devstack sudo[82481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:57 devstack sudo[82481]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.485s {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.manager [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Notifying Schedulers of capabilities ... {{(pid=82407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:57 devstack cinder-volume[82407]: INFO cinder.volume.manager [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Driver initialization completed successfully. Apr 15 10:07:57 devstack cinder-volume[82407]: INFO cinder.manager [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Initiating service 3 cleanup Apr 15 10:07:57 devstack cinder-volume[82407]: INFO cinder.manager [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Service 3 cleanup completed. Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.service [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Creating RPC server for service cinder-volume {{(pid=82407) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.service [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82407) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:07:57 devstack cinder-volume[82407]: INFO cinder.volume.manager [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:57 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:57 devstack sudo[82488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:07:57 devstack sudo[82488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:58 devstack sudo[82488]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:58 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.455s {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:58 devstack cinder-volume[82407]: INFO cinder.volume.manager [None req-b37b7d1b-0f7d-4641-9d90-cc11670c3183 None None] Driver post RPC initialization completed successfully. Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82407) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG cinder.volume.drivers.quobyte [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82407) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82407) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:01 devstack sudo[82551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:08:01 devstack sudo[82551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:01 devstack sudo[82551]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG oslo_concurrency.processutils [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.430s {{(pid=82407) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:01 devstack cinder-volume[82407]: DEBUG cinder.manager [None req-f85ff838-139a-4ccf-bc0a-72b3655fa7da None None] Notifying Schedulers of capabilities ... {{(pid=82407) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:03 devstack cinder-volume[82290]: INFO oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Caught SIGTERM, stopping children Apr 15 10:08:03 devstack cinder-volume[82290]: DEBUG oslo_concurrency.lockutils [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Acquiring lock "singleton_lock" {{(pid=82290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:08:03 devstack cinder-volume[82290]: DEBUG oslo_concurrency.lockutils [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Acquired lock "singleton_lock" {{(pid=82290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:08:03 devstack cinder-volume[82290]: DEBUG oslo_concurrency.lockutils [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Releasing lock "singleton_lock" {{(pid=82290) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:08:03 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Stop services. {{(pid=82290) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 10:08:03 devstack cinder-volume[82290]: DEBUG oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Killing children. {{(pid=82290) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 10:08:03 devstack cinder-volume[82290]: INFO oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Waiting on 1 children to exit Apr 15 10:08:05 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Acquiring lock "singleton_lock" {{(pid=82407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:08:05 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Acquired lock "singleton_lock" {{(pid=82407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:08:05 devstack cinder-volume[82407]: DEBUG oslo_concurrency.lockutils [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Releasing lock "singleton_lock" {{(pid=82407) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:08:05 devstack cinder-volume[82407]: WARNING amqp [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:08:05 devstack cinder-volume[82407]: WARNING amqp [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:08:05 devstack cinder-volume[82290]: INFO oslo_service.backend._eventlet.service [None req-d4d16d6b-d139-4c87-a64c-583d96fcfeb2 None None] Child 82407 exited with status 0 Apr 15 10:08:06 devstack cinder-volume[82629]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:08:06 devstack cinder-volume[82629]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:08:06 devstack cinder-volume[82629]: we strongly recommend against using it for new projects. Apr 15 10:08:06 devstack cinder-volume[82629]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:08:06 devstack cinder-volume[82629]: framework. For more detail see Apr 15 10:08:06 devstack cinder-volume[82629]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:08:06 devstack cinder-volume[82629]: import eventlet # noqa Apr 15 10:08:08 devstack cinder-volume[82629]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82629) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:08:08 devstack cinder-volume[82629]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82629) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:08:08 devstack cinder-volume[82629]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82629) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:08:09 devstack cinder-volume[82629]: INFO dbcounter [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Registered counter for database cinder Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG dbcounter [-] [82629] Writer thread running {{(pid=82629) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:08:09 devstack cinder-volume[82629]: INFO cinder.rpc [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:08:09 devstack cinder-volume[82629]: INFO cinder.rpc [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:08:09 devstack cinder-volume[82629]: INFO cinder.volume.manager [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Determined volume DB was empty at startup. Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG cinder.volume.manager [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82629) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:08:09 devstack cinder-volume[82629]: WARNING stevedore.named [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:08:09 devstack cinder-volume[82629]: WARNING castellan.key_manager [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:08:09 devstack cinder-volume[82629]: WARNING cinder.keymgr.conf_key_mgr [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:08:09 devstack cinder-volume[82629]: INFO cinder.volume.manager [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82629) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:08:09 devstack cinder-volume[82629]: INFO oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Starting 1 workers Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Started child 82850 {{(pid=82629) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Full set of CONF: {{(pid=82629) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] ******************************************************************************** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Configuration options gathered from: {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] ================================================================================ {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:08:09 devstack cinder-volume[82850]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] allow_availability_zone_fallback = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] allow_compression_on_image_upload = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] allowed_direct_url_schemes = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] api_rate_limit = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] auth_strategy = keystone {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_availability_zone = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_host = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_stats_polling_interval = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backup_api_class = cinder.backup.api.API {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backup_name_template = backup-%s {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backup_use_same_host = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backup_use_temp_snapshot = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] chap_password = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] chap_username = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_internal_tenant_project_id = 374d65ba9384407383d2385576ecf16d {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_internal_tenant_user_id = f90acb0fdfc143b8b607bf1e90e83902 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cluster = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] compression_format = gzip {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] compute_api_class = cinder.compute.nova.API {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] config_dir = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] config_source = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] control_exchange = openstack {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] debug = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] default_availability_zone = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] default_group_type = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] default_volume_type = QuobyteHD {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] disk_geometry = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] driver_client_cert = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] driver_client_cert_key = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] driver_data_namespace = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] driver_ssl_cert_path = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] driver_ssl_cert_verify = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] driver_use_ssl = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] enable_new_services = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] enable_unsupported_driver = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] enabled_backends = ['QuobyteHD'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] enforce_multipath_for_image_xfer = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] filter_function = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_api_insecure = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_api_servers = ['http://192.168.122.131/image'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_api_ssl_compression = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_ca_certificates_file = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_catalog_info = image:glance:publicURL {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_num_retries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance_request_timeout = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] goodness_function = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] graceful_shutdown_timeout = 5 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] group_api_class = cinder.group.api.API {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] host = devstack {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_compress_on_upload = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_conversion_address_space_limit = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82850) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_conversion_cpu_limit = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_conversion_disable = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_upload_use_cinder_backend = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_upload_use_internal_tenant = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_volume_cache_enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_volume_cache_max_count = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] image_volume_cache_max_size_gb = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] init_host_max_objects_retrieval = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] instance_format = [instance: %(uuid)s] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] iscsi_target_flags = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] iscsi_write_cache = on {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] iser_helper = tgtadm {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] iser_ip_address = 192.168.122.131 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] iser_port = 3260 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_color = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_config_append = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_dir = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_file = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_options = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_rotate_interval = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_rotate_interval_type = days {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] log_rotation_type = none {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] max_age = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] max_logfile_count = 30 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] max_logfile_size_mb = 200 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] max_over_subscription_ratio = 20.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] message_reap_interval = 86400 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] message_ttl = 2592000 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] migration_create_volume_timeout_secs = 300 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] monkey_patch = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] monkey_patch_modules = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] my_ip = 192.168.122.131 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] no_snapshot_gb_quota = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] num_iser_scan_tries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] num_shell_tries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] num_volume_device_scan_tries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] nvmeof_conn_info_version = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] nvmet_ns_id = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] nvmet_port_id = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] osapi_max_limit = 1000 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] osapi_volume_ext_list = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] osapi_volume_listen_port = 8776 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] osapi_volume_use_ssl = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] osapi_volume_workers = 2 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] per_volume_size_limit = -1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] periodic_fuzzy_delay = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] periodic_interval = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] public_endpoint = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] publish_errors = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] quota_backup_gigabytes = 1000 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] quota_backups = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] quota_gigabytes = 1000 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] quota_groups = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] quota_snapshots = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] quota_volumes = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] rate_limit_burst = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] rate_limit_except_level = CRITICAL {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] rate_limit_interval = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] reinit_driver_count = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] replication_device = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] report_discard_supported = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] report_interval = 120 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] reservation_clean_interval = 86400 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] reservation_expire = 86400 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] reserved_image_namespaces = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] reserved_percentage = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] rpc_response_timeout = 120 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] run_external_periodic_tasks = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] scst_target_driver = iscsi {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] scst_target_iqn_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_down_time = 720 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] shell_completion = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] snapshot_name_template = snapshot-%s {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] split_loggers = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] state_path = /opt/stack/data/cinder {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] storage_availability_zone = nova {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] storage_protocol = iSCSI {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] syslog_log_facility = LOG_USER {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] target_helper = lioadm {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] target_ip_address = 192.168.122.131 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] target_port = 3260 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] target_protocol = iscsi {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] target_secondary_ip_addresses = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] trace_flags = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] transport_url = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] until_refresh = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] use_chap_auth = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] use_default_quota_class = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] use_journal = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] use_json = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] use_multipath_for_image_xfer = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] use_stderr = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] use_syslog = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] verify_glance_signatures = enabled {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_api_class = cinder.volume.api.API {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_backend_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_clear = zero {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_clear_ionice = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_clear_size = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_copy_bps_limit = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_dd_blocksize = 1M {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82850) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 10:08:09 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 10:08:09 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_name_template = volume-%s {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_service_inithost_offload = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volume_usage_audit_period = month {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] zoning_mode = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Running cmd (subprocess): mount.quobyte {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_concurrency.disable_process_locking = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.admin_password = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.admin_token = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.admin_user = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_port = 35357 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_protocol = https {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_section = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_type = password {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_uri = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.auth_version = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.cache = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.identity_uri = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.include_service_catalog = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.insecure = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.interface = public {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_password = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcache_username = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.region_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.service_type = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.131/identity {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.backend = dogpile.cache.null {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.backend_argument = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.backend_expiration_time = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.config_prefix = cache.oslo {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.debug_cache_backend = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.enable_retry_client = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.enable_socket_keepalive = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.enforce_fips_mode = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.expiration_time = 600 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.hashclient_retry_attempts = 2 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.memcache_dead_retry = 300 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.memcache_pool_maxsize = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.memcache_sasl_enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.password = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.proxies = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.redis_db = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.redis_server = localhost:6379 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.retry_attempts = 2 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.retry_delay = 0.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.socket_keepalive_count = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.socket_keepalive_idle = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.socket_keepalive_interval = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.socket_timeout = 1.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.tls_allowed_ciphers = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.tls_cafile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.tls_certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.tls_enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.tls_keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cache.username = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] coordination.backend_url = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.asyncio_connection = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.asyncio_slave_connection = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.backend = sqlalchemy {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.connection = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.connection_debug = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.connection_parameters = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.connection_recycle_time = 3600 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.connection_trace = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.db_inc_retry_interval = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.db_max_retries = 20 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.db_max_retry_interval = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.db_retry_interval = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.max_overflow = 50 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.max_pool_size = 5 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.max_retries = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.mysql_wsrep_sync_wait = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.pool_timeout = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.retry_interval = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.slave_connection = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.sqlite_synchronous = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.synchronous_reader = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] database.use_db_reconnect = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack quobyte-client[82851]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 10:08:09 devstack quobyte-client[82851]: Invalid parameters found, error: missing mount point. Apr 15 10:08:09 devstack quobyte-client[82851]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 10:08:09 devstack quobyte-client[82851]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.connection_string = messaging:// {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.es_doc_type = notification {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.es_scroll_size = 10000 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.es_scroll_time = 2m {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.filter_error_trace = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.hmac_keys = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.sentinel_service_name = mymaster {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.socket_timeout = 0.1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.trace_requests = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler.trace_sqlalchemy = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler_jaeger.process_tags = {} {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler_jaeger.service_name_prefix = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] profiler_otlp.service_name_prefix = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.enforce_new_defaults = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: WARNING oslo_config.cfg [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.enforce_scope = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.policy_default_rule = default {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.policy_file = policy.yaml {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] privsep_osbrick.group = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] privsep_osbrick.helper_command = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] privsep_osbrick.user = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_sys_admin.group = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_sys_admin.helper_command = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] cinder_sys_admin.user = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.auth_section = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.auth_type = password {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.cafile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.collect_timing = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.insecure = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.send_service_user_token = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.split_loggers = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] service_user.timeout = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.auth_section = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.auth_type = password {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.collect_timing = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.insecure = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.region_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.split_loggers = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] glance.timeout = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.backend_availability_zone = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.chap_password = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.chap_username = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.disk_geometry = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.driver_client_cert = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.driver_client_cert_key = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.driver_data_namespace = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.driver_use_ssl = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.extra_capabilities = {} {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.filter_function = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.goodness_function = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.iscsi_target_flags = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.iscsi_write_cache = on {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.iser_helper = tgtadm {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.iser_ip_address = 192.168.122.131 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.iser_port = 3260 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack sudo[82852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_host = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack sudo[82852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_login = admin {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_mount_options = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_password = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_private_key = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_share_path = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.num_shell_tries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.quobyte_volume_url = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.replication_device = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.report_discard_supported = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.reserved_percentage = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.target_helper = tgtadm {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.target_ip_address = 192.168.122.131 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.target_port = 3260 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.target_protocol = iscsi {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.trace_flags = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.unique_fqdn_network = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.use_chap_auth = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_backend_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_clear = zero {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_clear_ionice = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_clear_size = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_reports.file_event_handler = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_reports.log_dir = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.backend_availability_zone = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.backend_host = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.chap_password = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.chap_username = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.chiscsi_conf = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.disk_geometry = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.driver_client_cert = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.driver_data_namespace = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.driver_use_ssl = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.extra_capabilities = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.filter_function = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.goodness_function = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.iser_helper = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.iser_ip_address = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.iser_port = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.iser_target_prefix = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_host = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_login = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_mount_options = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_password = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_private_key = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_share_path = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_ssh_port = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.num_shell_tries = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.nvmet_port_id = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.replication_device = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.report_discard_supported = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.reserved_percentage = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.scst_target_driver = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.storage_protocol = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.target_helper = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.target_ip_address = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.target_port = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.target_prefix = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.target_protocol = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.trace_flags = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.use_chap_auth = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_clear = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_clear_size = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] QuobyteHD.volumes_dir = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.ssl = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_notifications.driver = [] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_notifications.retry = -1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] key_manager.fixed_key = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.barbican_api_version = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.barbican_endpoint = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.barbican_endpoint_type = public {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.barbican_region_name = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.cafile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.collect_timing = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.insecure = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.number_of_retries = 60 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.retry_delay = 1 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.send_service_user_token = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.split_loggers = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.timeout = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.verify_ssl = True {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican.verify_ssl_path = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.auth_section = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.auth_type = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.cafile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.certfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.collect_timing = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.insecure = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.keyfile = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.split_loggers = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] barbican_service_user.timeout = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.approle_role_id = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.approle_secret_id = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.kv_mountpoint = secret {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.kv_path = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.kv_version = 2 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.namespace = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.root_token_id = **** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.ssl_ca_crt_file = None {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.timeout = 60.0 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.use_ssl = False {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:08:09 devstack cinder-volume[82629]: DEBUG oslo_service.backend._eventlet.service [None req-f2ed4922-3d2c-4311-a17c-c96c96f8dc98 None None] ******************************************************************************** {{(pid=82629) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:08:10 devstack sudo[82852]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.440s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:10 devstack cinder-volume[82850]: INFO cinder.volume.driver [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.volume.driver [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7315406799316, 'free_capacity_gb': 1775.7315406799316, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82850) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_db.sqlalchemy.engines [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writer thread running {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.db.sqlalchemy.api [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Building query based on filter {{(pid=82850) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82850) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:10 devstack cinder-volume[82850]: INFO cinder.keymgr.migration [None req-befd950e-bdb5-408f-acde-f8d23313aeae None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:08:10 devstack sudo[82868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:08:10 devstack sudo[82868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:10 devstack sudo[82868]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.499s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Driver initialization completed successfully. Apr 15 10:08:10 devstack cinder-volume[82850]: INFO cinder.manager [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Initiating service 3 cleanup Apr 15 10:08:10 devstack cinder-volume[82850]: INFO cinder.manager [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Service 3 cleanup completed. Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.service [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Creating RPC server for service cinder-volume {{(pid=82850) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.service [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82850) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:08:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:10 devstack sudo[82874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:08:10 devstack sudo[82874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:11 devstack sudo[82874]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cf12ce71-3a01-4ecd-869c-c4817ad48b36 None None] Driver post RPC initialization completed successfully. Apr 15 10:08:19 devstack cinder-volume[82629]: DEBUG dbcounter [-] [82629] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82629) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:08:20 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:08:21 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=2 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:09:09 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Flow 'volume_create_manager' (fa87f1e2-c0c5-44fa-9de9-e7310b243987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859370ce-e7c3-4817-8afe-8f73ab6c1485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859370ce-e7c3-4817-8afe-8f73ab6c1485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2146458233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a14649-9ed0-4757-b049-dcf846a5836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9246aac6fe7a43a592d75e306bc10417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:10Z,use_quota=True,user_id='da394b20cd2f47b38b11d0b3ad9fa0bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c616cbdb-e904-4597-8575-c78173cef326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c616cbdb-e904-4597-8575-c78173cef326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccf5562-8403-473a-95c0-d3bc5310b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccf5562-8403-473a-95c0-d3bc5310b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a14649-9ed0-4757-b049-dcf846a5836f', 'volume_name': 'volume-14a14649-9ed0-4757-b049-dcf846a5836f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e2d88-94ba-484f-99bb-92841c486fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e2d88-94ba-484f-99bb-92841c486fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad45ff3d-6281-43d2-b4cc-c6aa3fa75eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Volume 14a14649-9ed0-4757-b049-dcf846a5836f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a14649-9ed0-4757-b049-dcf846a5836f', 'volume_size': 1} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2146458233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a14649-9ed0-4757-b049-dcf846a5836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9246aac6fe7a43a592d75e306bc10417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:10Z,use_quota=True,user_id='da394b20cd2f47b38b11d0b3ad9fa0bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Creating volume 14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:10 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:10 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f 1073741824 Apr 15 10:09:10 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Flow 'volume_create_manager' (03aadd3d-9131-4209-888f-f439b3dbe7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a587e03d-566f-4391-af42-447585aad342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a587e03d-566f-4391-af42-447585aad342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-902814965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd72a86-e29b-4db3-8798-fe632771e382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8904e080e9a4d1286d5137b59313a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:11Z,use_quota=True,user_id='6388c392763f41ac912777c44dc0b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ec22f9-60d5-44d1-bfbf-7c2610268de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ec22f9-60d5-44d1-bfbf-7c2610268de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2197a3d8-e253-4749-9f4b-ab332e7794d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2197a3d8-e253-4749-9f4b-ab332e7794d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd72a86-e29b-4db3-8798-fe632771e382', 'volume_name': 'volume-9cd72a86-e29b-4db3-8798-fe632771e382', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cae8793-37f6-4f31-beef-4e9c51c7a76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cae8793-37f6-4f31-beef-4e9c51c7a76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a67c127-6dc7-4f70-a31a-100d4b3ce8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Volume 9cd72a86-e29b-4db3-8798-fe632771e382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd72a86-e29b-4db3-8798-fe632771e382', 'volume_size': 1} Apr 15 10:09:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:11 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f 1073741824" returned: 0 in 1.354s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[83592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f Apr 15 10:09:11 devstack sudo[83592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack sudo[83592]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f" returned: 0 in 0.674s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-902814965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd72a86-e29b-4db3-8798-fe632771e382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8904e080e9a4d1286d5137b59313a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:11Z,use_quota=True,user_id='6388c392763f41ac912777c44dc0b482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Creating volume 9cd72a86-e29b-4db3-8798-fe632771e382 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:12 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad45ff3d-6281-43d2-b4cc-c6aa3fa75eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a14649-9ed0-4757-b049-dcf846a5836f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95239de-5c29-41f1-8fa3-f386faf4501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:12 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 1073741824 Apr 15 10:09:12 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Volume volume-14a14649-9ed0-4757-b049-dcf846a5836f (14a14649-9ed0-4757-b049-dcf846a5836f): created successfully Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95239de-5c29-41f1-8fa3-f386faf4501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Flow 'volume_create_manager' (fa87f1e2-c0c5-44fa-9de9-e7310b243987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-07dea13f-5469-4910-885f-7aa59a4abfb8 req-1f373010-fed9-4198-a887-885364706389 tempest-VolumesSnapshotsTestJSON-1681556365 None] Created volume successfully. Apr 15 10:09:13 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 1073741824" returned: 0 in 0.982s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:13 devstack sudo[83602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 Apr 15 10:09:13 devstack sudo[83602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Flow 'volume_create_manager' (1a13b905-787d-4781-9f13-0c07bda66ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11804164-9573-44c8-aea9-04e716ade7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11804164-9573-44c8-aea9-04e716ade7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1487694469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c8f825-2a11-426f-8f75-aa7b32d2694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e847505a4f41a79e827d9fec302b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:13Z,use_quota=True,user_id='2a3cebf56d0c4a97b11eadc83b40eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dea8a2-bf95-4ca9-bcd5-25d7d62ceca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dea8a2-bf95-4ca9-bcd5-25d7d62ceca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d248d7d5-8b96-4625-9cd4-0910ca01ea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d248d7d5-8b96-4625-9cd4-0910ca01ea03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c8f825-2a11-426f-8f75-aa7b32d2694e', 'volume_name': 'volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7481fe6d-877d-4b17-afd4-9e2ea8040b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7481fe6d-877d-4b17-afd4-9e2ea8040b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6842b578-c0c2-47fd-b907-656bf17e2b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Volume c3c8f825-2a11-426f-8f75-aa7b32d2694e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e', 'volume_size': 1} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:14 devstack sudo[83602]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382" returned: 0 in 0.890s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1487694469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c8f825-2a11-426f-8f75-aa7b32d2694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e847505a4f41a79e827d9fec302b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:13Z,use_quota=True,user_id='2a3cebf56d0c4a97b11eadc83b40eb83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Creating volume c3c8f825-2a11-426f-8f75-aa7b32d2694e {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a67c127-6dc7-4f70-a31a-100d4b3ce8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd72a86-e29b-4db3-8798-fe632771e382', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdc8d97-97fe-4900-9699-44d02e4af6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Volume volume-9cd72a86-e29b-4db3-8798-fe632771e382 (9cd72a86-e29b-4db3-8798-fe632771e382): created successfully Apr 15 10:09:14 devstack sudo[83605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e 1073741824 Apr 15 10:09:14 devstack sudo[83605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdc8d97-97fe-4900-9699-44d02e4af6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Flow 'volume_create_manager' (03aadd3d-9131-4209-888f-f439b3dbe7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f589e56b-0e2e-4fb4-a122-677bb26fed71 tempest-DeleteServersTestJSON-1564137209 None] Created volume successfully. Apr 15 10:09:15 devstack sudo[83605]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e 1073741824" returned: 0 in 0.736s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:15 devstack sudo[83610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e Apr 15 10:09:15 devstack sudo[83610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:15 devstack sudo[83610]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e" returned: 0 in 0.827s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.081s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Creating offline snapshot 06a389b8-e7fa-4978-ba07-fcf1f3dd9396 of volume 14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:16 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6axw8qia/privsep.sock'] Apr 15 10:09:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6842b578-c0c2-47fd-b907-656bf17e2b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8cf1da-dda6-42c6-a7f7-b82bae22431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Volume volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e (c3c8f825-2a11-426f-8f75-aa7b32d2694e): created successfully Apr 15 10:09:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa8cf1da-dda6-42c6-a7f7-b82bae22431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Flow 'volume_create_manager' (1a13b905-787d-4781-9f13-0c07bda66ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:16 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6axw8qia/privsep.sock Apr 15 10:09:16 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fccc18ce-406c-4379-b388-d9f82a6b6760 tempest-VolumesAdminNegativeTest-1831183753 None] Created volume successfully. Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:09:16 devstack cinder-volume[82850]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 10:09:17 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:17 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Spawned new privsep daemon via rootwrap Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Accepted privsep connection to /tmp/tmp6axw8qia/privsep.sock {{(pid=82850) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 10:09:17 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 10:09:17 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 10:09:17 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 10:09:17 devstack cinder-volume[82850]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83626 Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab02070-2467-46f1-b1c9-236e0baefc0e]: (2,) {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8916c5c6-da7e-4dec-a861-621c5ec457e9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Acquiring lock "cinder-c3c8f825-2a11-426f-8f75-aa7b32d2694e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Lock "cinder-c3c8f825-2a11-426f-8f75-aa7b32d2694e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Acquiring lock "cinder-quobyte-c3c8f825-2a11-426f-8f75-aa7b32d2694e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Lock "cinder-quobyte-c3c8f825-2a11-426f-8f75-aa7b32d2694e" acquired by "delete_volume" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:17 devstack sudo[83628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f Apr 15 10:09:17 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bd2cf1-dcb7-4e46-b41c-ebb4ecb31b54]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:17 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e Apr 15 10:09:17 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:18 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f" returned: 0 in 0.938s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:18 devstack sudo[83635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 1G Apr 15 10:09:18 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e" returned: 0 in 1.218s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:18 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:18 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e Apr 15 10:09:18 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:19 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c3c8f825-2a11-426f-8f75-aa7b32d2694e" returned: 0 in 0.975s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Lock "cinder-quobyte-c3c8f825-2a11-426f-8f75-aa7b32d2694e" released by "delete_volume" :: held 2.251s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:19 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 1G" returned: 0 in 1.499s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a14649-9ed0-4757-b049-dcf846a5836f -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:19 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a14649-9ed0-4757-b049-dcf846a5836f -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 Apr 15 10:09:19 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:19 devstack cinder-volume[82850]: WARNING cinder.quota [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:19 devstack cinder-volume[82850]: WARNING cinder.quota [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:19 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Created reservations ['e8f529f4-bac1-4867-9746-2c6c71d0824b', '7fa3ece7-af88-47c1-bb23-4fd06a04bc00', '1514e33e-7327-4ec7-b332-0e57c8e3280d', '7a89a2b0-9ae8-499a-9558-2fd4639e637e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:20 devstack sudo[83652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:09:20 devstack sudo[83652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:21 devstack sudo[83652]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.287s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Deleted volume successfully. Apr 15 10:09:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-901c7664-1cd1-4b82-ba8a-999065a5161c tempest-VolumesAdminNegativeTest-1831183753 None] Lock "cinder-c3c8f825-2a11-426f-8f75-aa7b32d2694e-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:21 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a14649-9ed0-4757-b049-dcf846a5836f -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396" returned: 0 in 1.709s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:21 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 is being set with open permissions: ugo+rw Apr 15 10:09:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:21 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 Apr 15 10:09:21 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:22 devstack cinder-volume[82850]: WARNING py.warnings [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 15 10:09:22 devstack cinder-volume[82850]: .first() Apr 15 10:09:22 devstack cinder-volume[82850]: Apr 15 10:09:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:22 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396" returned: 0 in 1.245s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:22 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.info Apr 15 10:09:22 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:23 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.info" returned: 0 in 0.725s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:23 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.info is being set with open permissions: ugo+rw Apr 15 10:09:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:23 devstack sudo[83704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.info Apr 15 10:09:23 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:24 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.info" returned: 0 in 0.620s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.291s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.633s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19c7667-6254-461b-a64a-41ea4d3dbecd]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-4619c04f-1585-4536-981f-a204fe81cc64 req-e14d8565-75a0-49a1-a3fb-add0457f31f7 tempest-VolumesSnapshotsTestJSON-1681556365 None] Create snapshot completed successfully Apr 15 10:09:24 devstack sudo[83708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 Apr 15 10:09:24 devstack sudo[83708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "cinder-06a389b8-e7fa-4978-ba07-fcf1f3dd9396-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-06a389b8-e7fa-4978-ba07-fcf1f3dd9396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "cinder-quobyte-14a14649-9ed0-4757-b049-dcf846a5836f" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-quobyte-14a14649-9ed0-4757-b049-dcf846a5836f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "cinder-quobyte-06a389b8-e7fa-4978-ba07-fcf1f3dd9396" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-quobyte-06a389b8-e7fa-4978-ba07-fcf1f3dd9396" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Deleting offline snapshot 06a389b8-e7fa-4978-ba07-fcf1f3dd9396 of volume 14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] snapshot_file for this snap is: volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca5dc2-45d8-4d41-afc1-a71d39cb47a5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:25 devstack sudo[83708]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382" returned: 0 in 1.068s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.084s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:25 devstack sudo[83715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 Apr 15 10:09:25 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383', 'name': 'volume-9cd72a86-e29b-4db3-8798-fe632771e382', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e72df31e-6549-4d28-aeba-536676020a58', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:09:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-b4a9da34-dddb-4349-92ca-eca28f851b99 req-5281ab36-a419-4f56-a320-e5888dc5de94 tempest-DeleteServersTestJSON-1564137209 None] attachment_update completed successfully. Apr 15 10:09:26 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396" returned: 0 in 0.831s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a14649-9ed0-4757-b049-dcf846a5836f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ded928-6395-483f-9d9d-46c08d9f3ddf]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:26 devstack sudo[83788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f Apr 15 10:09:26 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:27 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f" returned: 0 in 0.951s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:27 devstack sudo[84112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 Apr 15 10:09:27 devstack sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:27 devstack sudo[84112]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396" returned: 0 in 0.794s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:27 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396 Apr 15 10:09:27 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:28 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f.06a389b8-e7fa-4978-ba07-fcf1f3dd9396" returned: 0 in 0.675s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-quobyte-06a389b8-e7fa-4978-ba07-fcf1f3dd9396" released by "_delete_snapshot" :: held 3.359s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-quobyte-14a14649-9ed0-4757-b049-dcf846a5836f" released by "delete_snapshot" :: held 3.391s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:28 devstack cinder-volume[82850]: WARNING cinder.quota [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:28 devstack cinder-volume[82850]: DEBUG cinder.quota [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Created reservations ['14345d09-ee99-41d9-a3a8-aefceebc4336', '6246361f-00ef-4140-b466-eb431d5866ed', 'd4845573-538c-4eff-9262-cc13f06c8298', '5aa4d1f8-8011-47de-8fa2-7e1b353acc79'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Delete snapshot completed successfully. Apr 15 10:09:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-f3a4fb9a-c8b9-4284-9766-1faa7e7224f9 req-e74a7114-365f-4723-bc88-99cbba7d605b tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-06a389b8-e7fa-4978-ba07-fcf1f3dd9396-delete_snapshot" released by "delete_snapshot" :: held 3.547s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "cinder-14a14649-9ed0-4757-b049-dcf846a5836f-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-14a14649-9ed0-4757-b049-dcf846a5836f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "cinder-quobyte-14a14649-9ed0-4757-b049-dcf846a5836f" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-quobyte-14a14649-9ed0-4757-b049-dcf846a5836f" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c032b675-bf02-4e4b-a66b-d70986cdb588]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:29 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f Apr 15 10:09:29 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:30 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f" returned: 0 in 0.945s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:30 devstack sudo[84170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f Apr 15 10:09:30 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:31 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-14a14649-9ed0-4757-b049-dcf846a5836f" returned: 0 in 0.736s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-quobyte-14a14649-9ed0-4757-b049-dcf846a5836f" released by "delete_volume" :: held 1.741s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG cinder.quota [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Created reservations ['756ee818-d446-41b1-a096-56166fdb5ce7', '6adb6b26-005c-46a5-b512-2a65947a4f91', '8e1a8f71-a6b1-40aa-b148-fd52f61edfea', '9a91191a-49c2-4b5b-9466-95fd9cc8f2d3'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:31 devstack sudo[84199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:09:31 devstack sudo[84199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:32 devstack sudo[84199]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.680s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:32 devstack cinder-volume[82850]: DEBUG cinder.manager [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Deleted volume successfully. Apr 15 10:09:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-2d6011e1-6907-4c86-9598-0ec9b4420c91 req-af097702-828a-472f-9261-d09d2fb36b37 tempest-VolumesSnapshotsTestJSON-1681556365 None] Lock "cinder-14a14649-9ed0-4757-b049-dcf846a5836f-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:09:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:33 devstack sudo[84231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:09:33 devstack sudo[84231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:34 devstack sudo[84231]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.740s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-f7068064-1e86-4628-9718-365a26c0f4f6 req-c3571578-0fb3-437f-b1ba-af7f2f1e0313 tempest-DeleteServersTestJSON-1564137209 None] Terminate volume connection completed successfully. Apr 15 10:09:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-f7068064-1e86-4628-9718-365a26c0f4f6 req-c3571578-0fb3-437f-b1ba-af7f2f1e0313 tempest-DeleteServersTestJSON-1564137209 None] Deleting attachment e72df31e-6549-4d28-aeba-536676020a58. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:09:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Acquiring lock "cinder-9cd72a86-e29b-4db3-8798-fe632771e382-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Lock "cinder-9cd72a86-e29b-4db3-8798-fe632771e382-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Acquiring lock "cinder-quobyte-9cd72a86-e29b-4db3-8798-fe632771e382" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Lock "cinder-quobyte-9cd72a86-e29b-4db3-8798-fe632771e382" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec78626-0787-4406-a7ce-7b2d4f05283b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:39 devstack sudo[84258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 Apr 15 10:09:39 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:40 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382" returned: 0 in 0.662s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:40 devstack sudo[84267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382 Apr 15 10:09:40 devstack sudo[84267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:40 devstack sudo[84267]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9cd72a86-e29b-4db3-8798-fe632771e382" returned: 0 in 0.512s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Lock "cinder-quobyte-9cd72a86-e29b-4db3-8798-fe632771e382" released by "delete_volume" :: held 1.200s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Created reservations ['b1a8f223-1a50-40cd-9166-450a9cfb0020', '5a6df78c-2bad-481b-9aa7-96852fde56ea', '579973d4-23ce-41cc-8e8f-255631994574', 'e843f83a-77c5-4081-86f5-8b5ecadb8a40'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:40 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:09:40 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:41 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.611s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:41 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Deleted volume successfully. Apr 15 10:09:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-82688dee-d8b9-4287-b5bb-d3abb74b6fa9 tempest-DeleteServersTestJSON-1564137209 None] Lock "cinder-9cd72a86-e29b-4db3-8798-fe632771e382-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Flow 'volume_create_manager' (98fa77d0-f41b-48c2-9dfb-f8f74747d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f8ea14-c355-49ea-ba15-faaecbf17d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f8ea14-c355-49ea-ba15-faaecbf17d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1642528215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b6dff0-3306-49da-a0af-8428c202fabc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='624d7ec3588e4759bc30c4e496e76e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:49Z,use_quota=True,user_id='547737aeba56413c9a477bc229e30a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc69499-84eb-42fb-bbc3-fe7ce31fe232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc69499-84eb-42fb-bbc3-fe7ce31fe232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d617e5-2a59-4844-9b05-1df3de082c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d617e5-2a59-4844-9b05-1df3de082c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b6dff0-3306-49da-a0af-8428c202fabc', 'volume_name': 'volume-e9b6dff0-3306-49da-a0af-8428c202fabc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d7544-defb-47df-993b-5e2569a027d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9d7544-defb-47df-993b-5e2569a027d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7c6711-12e3-4d01-a3ea-ec93ad992bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:48 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Volume e9b6dff0-3306-49da-a0af-8428c202fabc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b6dff0-3306-49da-a0af-8428c202fabc', 'volume_size': 1} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1642528215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b6dff0-3306-49da-a0af-8428c202fabc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='624d7ec3588e4759bc30c4e496e76e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:49Z,use_quota=True,user_id='547737aeba56413c9a477bc229e30a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Creating volume e9b6dff0-3306-49da-a0af-8428c202fabc {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:48 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:09:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:48 devstack sudo[84315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc 1073741824 Apr 15 10:09:48 devstack sudo[84315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:49 devstack sudo[84315]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc 1073741824" returned: 0 in 0.819s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:49 devstack sudo[84320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc Apr 15 10:09:49 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:50 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc" returned: 0 in 0.672s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b7c6711-12e3-4d01-a3ea-ec93ad992bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b6dff0-3306-49da-a0af-8428c202fabc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f445b680-ec30-4c0d-a108-902c3f104070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:50 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Volume volume-e9b6dff0-3306-49da-a0af-8428c202fabc (e9b6dff0-3306-49da-a0af-8428c202fabc): created successfully Apr 15 10:09:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f445b680-ec30-4c0d-a108-902c3f104070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Flow 'volume_create_manager' (98fa77d0-f41b-48c2-9dfb-f8f74747d522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-01d967d4-804c-48fc-9b17-58fc24082e37 req-4def1389-da17-4f4c-9f5f-80c7fd8c9dbd tempest-VolumesGetTestJSON-981088552 None] Created volume successfully. Apr 15 10:09:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Acquiring lock "cinder-e9b6dff0-3306-49da-a0af-8428c202fabc-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Lock "cinder-e9b6dff0-3306-49da-a0af-8428c202fabc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Acquiring lock "cinder-quobyte-e9b6dff0-3306-49da-a0af-8428c202fabc" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Lock "cinder-quobyte-e9b6dff0-3306-49da-a0af-8428c202fabc" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e05d7b6-60de-48c1-a5d9-71f1dd793a57]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:51 devstack sudo[84324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc Apr 15 10:09:51 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc" returned: 0 in 1.096s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:52 devstack sudo[84351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc Apr 15 10:09:52 devstack sudo[84351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:53 devstack sudo[84351]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e9b6dff0-3306-49da-a0af-8428c202fabc" returned: 0 in 0.566s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Lock "cinder-quobyte-e9b6dff0-3306-49da-a0af-8428c202fabc" released by "delete_volume" :: held 1.689s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG cinder.quota [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Created reservations ['73fbff89-0892-4550-9f13-e820be41e9f6', '1623c3eb-c3d9-4653-b737-ae67ec7a44aa', '48ed0963-e125-45e7-b2d1-01dac64ea8be', '60d5ded7-93e4-44ae-b03e-28ef4651322d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack sudo[84356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:09:53 devstack sudo[84356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:54 devstack sudo[84356]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.997s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:54 devstack cinder-volume[82850]: DEBUG cinder.manager [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Deleted volume successfully. Apr 15 10:09:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-dda10853-1e7e-497b-9b22-0568caea97cb req-b3455933-cd09-4076-9ff5-df82137a8300 tempest-VolumesGetTestJSON-981088552 None] Lock "cinder-e9b6dff0-3306-49da-a0af-8428c202fabc-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Flow 'volume_create_manager' (f5aa41ea-b6cf-499c-afe9-69d8b7236cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03785702-860b-424c-92b5-5bbb331d2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03785702-860b-424c-92b5-5bbb331d2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1312334833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b8b682-ae94-4a69-9e84-a3a2d99e1384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99a5243e9a34525b20700cc792d160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:59Z,use_quota=True,user_id='290c9456d51a47aa8ba8149fa3955417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb9a911-007b-4166-bb2b-a03f1749e996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb9a911-007b-4166-bb2b-a03f1749e996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac30ac7d-4520-4fd8-aef4-daa17c0e9445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac30ac7d-4520-4fd8-aef4-daa17c0e9445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b8b682-ae94-4a69-9e84-a3a2d99e1384', 'volume_name': 'volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84da241e-213f-4173-940f-dcd7f1478d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84da241e-213f-4173-940f-dcd7f1478d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00fdf1b-dea2-4c5c-8fdc-32c0ac84cf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Volume c7b8b682-ae94-4a69-9e84-a3a2d99e1384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384', 'volume_size': 1} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1312334833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b8b682-ae94-4a69-9e84-a3a2d99e1384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99a5243e9a34525b20700cc792d160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:59Z,use_quota=True,user_id='290c9456d51a47aa8ba8149fa3955417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Creating volume c7b8b682-ae94-4a69-9e84-a3a2d99e1384 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:58 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:09:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:58 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 1073741824 Apr 15 10:09:58 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:59 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 1073741824" returned: 0 in 1.102s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:59 devstack sudo[84367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 Apr 15 10:09:59 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:00 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384" returned: 0 in 0.749s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00fdf1b-dea2-4c5c-8fdc-32c0ac84cf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b91aca-9ea7-4f24-a6a1-e7b0c4914dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:00 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Volume volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 (c7b8b682-ae94-4a69-9e84-a3a2d99e1384): created successfully Apr 15 10:10:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b91aca-9ea7-4f24-a6a1-e7b0c4914dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Flow 'volume_create_manager' (f5aa41ea-b6cf-499c-afe9-69d8b7236cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-318f676b-e127-44ca-bf2a-e2d29cacf247 tempest-VolumesTestJSON-62240047 None] Created volume successfully. Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=50,cinder:UPDATE=38,cinder:DELETE=3,cinder:INSERT=16 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=42,cinder:INSERT=10,cinder:UPDATE=74,cinder:DELETE=7 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Flow 'volume_create_manager' (3801a16b-f8e5-4224-b6c9-bcb2638eca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208fac00-8270-407d-a10c-45c38f14e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208fac00-8270-407d-a10c-45c38f14e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1182643430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99a5243e9a34525b20700cc792d160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:02Z,use_quota=True,user_id='290c9456d51a47aa8ba8149fa3955417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f482f5b-d263-43aa-99b0-c24bf3779112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f482f5b-d263-43aa-99b0-c24bf3779112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806f5805-dd75-4659-87aa-491fa1a17f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806f5805-dd75-4659-87aa-491fa1a17f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e', 'volume_name': 'volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dc6f36-0c5c-44ef-bd0b-b203d131ecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95dc6f36-0c5c-44ef-bd0b-b203d131ecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cea657-3dbb-4dde-af82-4628363e753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Volume 3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e', 'volume_size': 1} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1182643430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99a5243e9a34525b20700cc792d160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:02Z,use_quota=True,user_id='290c9456d51a47aa8ba8149fa3955417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Creating volume 3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:02 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:02 devstack sudo[84398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e 1073741824 Apr 15 10:10:02 devstack sudo[84398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:02 devstack sudo[84398]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e 1073741824" returned: 0 in 0.798s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:02 devstack sudo[84407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e Apr 15 10:10:02 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:03 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e" returned: 0 in 0.663s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cea657-3dbb-4dde-af82-4628363e753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96585570-bfec-4bbb-8e91-14173f51fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Volume volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e (3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e): created successfully Apr 15 10:10:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96585570-bfec-4bbb-8e91-14173f51fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Flow 'volume_create_manager' (3801a16b-f8e5-4224-b6c9-bcb2638eca40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-154fea3f-86c9-4602-af2e-f52d782c88ea tempest-VolumesTestJSON-62240047 None] Created volume successfully. Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Flow 'volume_create_manager' (df0c50f1-9786-4d00-8115-094a0dce1466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238da954-1983-46f6-9e7c-5ab8d2baf82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238da954-1983-46f6-9e7c-5ab8d2baf82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-527392012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706367f1-1d88-46b9-b573-d0d255a03d16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99a5243e9a34525b20700cc792d160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:04Z,use_quota=True,user_id='290c9456d51a47aa8ba8149fa3955417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382bdc1c-1748-4124-b9de-1283ae2e70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382bdc1c-1748-4124-b9de-1283ae2e70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cf391b-fff6-46d7-aa3d-b754d4862431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cf391b-fff6-46d7-aa3d-b754d4862431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '706367f1-1d88-46b9-b573-d0d255a03d16', 'volume_name': 'volume-706367f1-1d88-46b9-b573-d0d255a03d16', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dfbc83-5093-4eb8-8206-93556fc4a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1dfbc83-5093-4eb8-8206-93556fc4a37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08acc3af-de88-4cf0-894a-5c4b84396024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Volume 706367f1-1d88-46b9-b573-d0d255a03d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-706367f1-1d88-46b9-b573-d0d255a03d16', 'volume_size': 1} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-527392012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=706367f1-1d88-46b9-b573-d0d255a03d16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99a5243e9a34525b20700cc792d160a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:04Z,use_quota=True,user_id='290c9456d51a47aa8ba8149fa3955417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Creating volume 706367f1-1d88-46b9-b573-d0d255a03d16 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:04 devstack sudo[84414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 1073741824 Apr 15 10:10:04 devstack sudo[84414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:05 devstack sudo[84414]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 1073741824" returned: 0 in 0.689s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:05 devstack sudo[84422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 Apr 15 10:10:05 devstack sudo[84422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:05 devstack sudo[84422]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16" returned: 0 in 0.588s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08acc3af-de88-4cf0-894a-5c4b84396024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-706367f1-1d88-46b9-b573-d0d255a03d16', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d4084f-b4ee-4a59-9c7d-76c40ad80311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Volume volume-706367f1-1d88-46b9-b573-d0d255a03d16 (706367f1-1d88-46b9-b573-d0d255a03d16): created successfully Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d4084f-b4ee-4a59-9c7d-76c40ad80311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Flow 'volume_create_manager' (df0c50f1-9786-4d00-8115-094a0dce1466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-52f14dc2-128c-49b7-982d-4fe1a24cbadd tempest-VolumesTestJSON-62240047 None] Created volume successfully. Apr 15 10:10:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Acquiring lock "cinder-706367f1-1d88-46b9-b573-d0d255a03d16-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Lock "cinder-706367f1-1d88-46b9-b573-d0d255a03d16-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Acquiring lock "cinder-quobyte-706367f1-1d88-46b9-b573-d0d255a03d16" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Lock "cinder-quobyte-706367f1-1d88-46b9-b573-d0d255a03d16" acquired by "delete_volume" :: waited 0.032s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:08 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c27d55-e3f4-4db2-9c65-110e64d21a12]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:08 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 Apr 15 10:10:08 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:10 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16" returned: 0 in 1.900s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:10 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16 Apr 15 10:10:10 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:11 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-706367f1-1d88-46b9-b573-d0d255a03d16" returned: 0 in 1.569s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Lock "cinder-quobyte-706367f1-1d88-46b9-b573-d0d255a03d16" released by "delete_volume" :: held 3.526s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:11 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Created reservations ['f57e0516-4d7e-4992-bd59-d40388259c90', '75a71c37-d753-4e9a-944c-e4aa219aec97', 'eff1b88f-0816-4fe7-b025-9f8540a5fd10', '74b7c5f0-6804-4500-b5f2-250a856b6643'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:12 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:12 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:12 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.803s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Deleted volume successfully. Apr 15 10:10:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9605b650-e7a8-400c-a3cf-43e86220295c tempest-VolumesTestJSON-62240047 None] Lock "cinder-706367f1-1d88-46b9-b573-d0d255a03d16-delete_volume" released by "delete_volume" :: held 4.706s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Acquiring lock "cinder-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Lock "cinder-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Acquiring lock "cinder-quobyte-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Lock "cinder-quobyte-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4f1200-5c10-4eef-ada3-7f4d6b832bfc]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:13 devstack sudo[84513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e Apr 15 10:10:13 devstack sudo[84513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Flow 'volume_create_manager' (26acae09-23ca-4571-bcb8-b845ad0c5f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e51b23e-3457-4ed2-8d22-1097ef0ffe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e51b23e-3457-4ed2-8d22-1097ef0ffe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1984782606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebb8f98-9f99-4de3-87d0-23af9db84002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac9b590eca5470d9f837ff00c026bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:13Z,use_quota=True,user_id='32062ee0e6f946c59fb8b9c24804108c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e65d0f1f-20aa-4c4d-b0ba-2ebbcdca8328),volume_type_id=e65d0f1f-20aa-4c4d-b0ba-2ebbcdca8328)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2616e-1d01-457b-883f-64acd4218259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2616e-1d01-457b-883f-64acd4218259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96e14a5-f253-481d-b74a-6314836608bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96e14a5-f253-481d-b74a-6314836608bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebb8f98-9f99-4de3-87d0-23af9db84002', 'volume_name': 'volume-1ebb8f98-9f99-4de3-87d0-23af9db84002', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7c0010-71a4-43f9-9ffa-0498e755ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7c0010-71a4-43f9-9ffa-0498e755ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d8064b-28fb-4dad-8afd-63b90121c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Volume 1ebb8f98-9f99-4de3-87d0-23af9db84002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebb8f98-9f99-4de3-87d0-23af9db84002', 'volume_size': 1} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1984782606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ebb8f98-9f99-4de3-87d0-23af9db84002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac9b590eca5470d9f837ff00c026bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:13Z,use_quota=True,user_id='32062ee0e6f946c59fb8b9c24804108c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e65d0f1f-20aa-4c4d-b0ba-2ebbcdca8328),volume_type_id=e65d0f1f-20aa-4c4d-b0ba-2ebbcdca8328)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Creating volume 1ebb8f98-9f99-4de3-87d0-23af9db84002 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:13 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:13 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 1073741824 Apr 15 10:10:13 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[84513]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e" returned: 0 in 1.023s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e Apr 15 10:10:14 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 1073741824" returned: 0 in 0.623s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 Apr 15 10:10:14 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e" returned: 0 in 0.736s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Lock "cinder-quobyte-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e" released by "delete_volume" :: held 1.787s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:14 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Created reservations ['70a03177-ab91-48b4-8c2e-acc831745d8d', 'dfd56d7c-37f0-4d21-a794-639417638136', '1b12a3f8-bd3f-4c2f-ae86-cae62b315de2', '5de8be4d-9b96-4c99-98a9-5b6344b285a8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:15 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002" returned: 0 in 0.685s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d8064b-28fb-4dad-8afd-63b90121c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebb8f98-9f99-4de3-87d0-23af9db84002', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack sudo[84538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:15 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca05a2e-da35-4e3a-b201-798326b2e880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Volume volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 (1ebb8f98-9f99-4de3-87d0-23af9db84002): created successfully Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca05a2e-da35-4e3a-b201-798326b2e880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Flow 'volume_create_manager' (26acae09-23ca-4571-bcb8-b845ad0c5f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a6e43f19-1c0d-4547-9f84-f129537db6a9 tempest-VolumeTypesAccessTest-2113419924 None] Created volume successfully. Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Acquiring lock "cinder-c7b8b682-ae94-4a69-9e84-a3a2d99e1384-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Lock "cinder-c7b8b682-ae94-4a69-9e84-a3a2d99e1384-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Acquiring lock "cinder-quobyte-c7b8b682-ae94-4a69-9e84-a3a2d99e1384" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Lock "cinder-quobyte-c7b8b682-ae94-4a69-9e84-a3a2d99e1384" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6923cbe7-dd12-4a43-bf41-84710391509a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:15 devstack sudo[84540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 Apr 15 10:10:15 devstack sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:15 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.644s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Deleted volume successfully. Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3bc953e6-b056-451d-b4e0-d13c765b313d tempest-VolumesTestJSON-62240047 None] Lock "cinder-3bf4b6b9-8ad5-411c-af12-5b80d01c2b0e-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Acquiring lock "cinder-1ebb8f98-9f99-4de3-87d0-23af9db84002-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Lock "cinder-1ebb8f98-9f99-4de3-87d0-23af9db84002-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Acquiring lock "cinder-quobyte-1ebb8f98-9f99-4de3-87d0-23af9db84002" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Lock "cinder-quobyte-1ebb8f98-9f99-4de3-87d0-23af9db84002" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1495546-216c-471d-86f4-1459aeffab91]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack sudo[84543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 Apr 15 10:10:16 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:16 devstack sudo[84540]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384" returned: 0 in 0.834s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack sudo[84548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384 Apr 15 10:10:16 devstack sudo[84548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:16 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002" returned: 0 in 0.664s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack sudo[84556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002 Apr 15 10:10:16 devstack sudo[84556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:16 devstack sudo[84548]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7b8b682-ae94-4a69-9e84-a3a2d99e1384" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Lock "cinder-quobyte-c7b8b682-ae94-4a69-9e84-a3a2d99e1384" released by "delete_volume" :: held 1.357s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Created reservations ['7ebff680-bfb7-4cd6-8065-4c9be0bec466', '48f4402c-468e-458d-9927-ea55b6c5873a', '0fa1479d-05f3-4ccd-b256-353a56992b34', '13a4d0fc-2a70-40a3-857e-415ca04b45b3'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack sudo[84559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:16 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[84556]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ebb8f98-9f99-4de3-87d0-23af9db84002" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Lock "cinder-quobyte-1ebb8f98-9f99-4de3-87d0-23af9db84002" released by "delete_volume" :: held 1.189s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:17 devstack cinder-volume[82850]: WARNING cinder.quota [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1761808065 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1761808065, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:17 devstack cinder-volume[82850]: WARNING cinder.quota [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1761808065 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1761808065, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Created reservations ['e7aabcb6-6ac9-4709-9585-14258f3a1607', 'c26ea136-6199-4ad4-819d-126070a3b3aa', '01902841-69cf-477e-a7af-cd8eac5da784', 'd4dd7a30-c1ca-4425-a1d4-41ce2d5e8765'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[84562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:17 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.484s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Deleted volume successfully. Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d61e5e4-ed09-4f8d-87c8-05ab1a90b5f2 tempest-VolumesTestJSON-62240047 None] Lock "cinder-c7b8b682-ae94-4a69-9e84-a3a2d99e1384-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:17 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.501s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Deleted volume successfully. Apr 15 10:10:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-11ef5907-dcb2-4eab-979d-c5963b972f2d tempest-VolumeTypesAccessTest-2113419924 None] Lock "cinder-1ebb8f98-9f99-4de3-87d0-23af9db84002-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Flow 'volume_create_manager' (406cc154-3155-4b4d-9230-cd16577f86c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5301c1-85bb-4ce4-b678-384d1b4591a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5301c1-85bb-4ce4-b678-384d1b4591a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1564441085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46304127-748a-4f68-8563-6ce8106922cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38543428bbc845dc97095825847bca0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:20Z,use_quota=True,user_id='a8473d849840444ea4b463b078ff32e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ad02d0-4cd2-4477-a513-bdadf77af2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ad02d0-4cd2-4477-a513-bdadf77af2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9abcb8c-765b-4234-9f0a-0d808190c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9abcb8c-765b-4234-9f0a-0d808190c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46304127-748a-4f68-8563-6ce8106922cf', 'volume_name': 'volume-46304127-748a-4f68-8563-6ce8106922cf', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddbc8cc-1769-4724-9594-d597d836a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddbc8cc-1769-4724-9594-d597d836a148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8346ee-e75d-47c5-b3bf-7c3bc1c2a81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Volume 46304127-748a-4f68-8563-6ce8106922cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46304127-748a-4f68-8563-6ce8106922cf', 'volume_size': 1} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1564441085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46304127-748a-4f68-8563-6ce8106922cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38543428bbc845dc97095825847bca0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:20Z,use_quota=True,user_id='a8473d849840444ea4b463b078ff32e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Creating volume 46304127-748a-4f68-8563-6ce8106922cf {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:19 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:19 devstack sudo[84599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf 1073741824 Apr 15 10:10:19 devstack sudo[84599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:20 devstack sudo[84599]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf 1073741824" returned: 0 in 1.010s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:20 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf Apr 15 10:10:20 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:21 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf" returned: 0 in 0.914s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8346ee-e75d-47c5-b3bf-7c3bc1c2a81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46304127-748a-4f68-8563-6ce8106922cf', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a05eeb-da60-459d-9b6b-820b54866018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Volume volume-46304127-748a-4f68-8563-6ce8106922cf (46304127-748a-4f68-8563-6ce8106922cf): created successfully Apr 15 10:10:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a05eeb-da60-459d-9b6b-820b54866018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Flow 'volume_create_manager' (406cc154-3155-4b4d-9230-cd16577f86c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ec76a822-4a58-4e23-b714-6b0e19f088af tempest-ServersNegativeTestJSON-395576179 None] Created volume successfully. Apr 15 10:10:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-172b131d-aef0-4cbd-b822-2342a388f424 tempest-GroupSnapshotsV319Test-602797567 None] Group tempest-GroupSnapshotsV319Test-Group-517034761: creating Apr 15 10:10:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-172b131d-aef0-4cbd-b822-2342a388f424 tempest-GroupSnapshotsV319Test-602797567 None] Group tempest-GroupSnapshotsV319Test-Group-517034761: created successfully Apr 15 10:10:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-172b131d-aef0-4cbd-b822-2342a388f424 tempest-GroupSnapshotsV319Test-602797567 None] Create group completed successfully. Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Flow 'volume_create_manager' (9177a997-8fb1-46c5-b457-b6c4e1f424bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a0c3e0-92d5-4f86-a0cb-543f5daa3803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a0c3e0-92d5-4f86-a0cb-543f5daa3803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1400623025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=180a0433-94b2-4a3a-8a59-aeac4ba2f253,host='devstack@QuobyteHD#QuobyteHD',id=ab26eaf3-8259-4043-adc5-f77d0557b905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b545bf6b69d40b1b7a44bf1a33062e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='e242e8d4c2824ffba3cae839ff16b210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(692592f7-462f-418a-aa44-cf348017a5c9),volume_type_id=692592f7-462f-418a-aa44-cf348017a5c9)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0874416-4a41-456d-89a4-b1ce7d68ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0874416-4a41-456d-89a4-b1ce7d68ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d350e3c3-5c47-4f51-9d5d-1a9361b5ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d350e3c3-5c47-4f51-9d5d-1a9361b5ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab26eaf3-8259-4043-adc5-f77d0557b905', 'volume_name': 'volume-ab26eaf3-8259-4043-adc5-f77d0557b905', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba9be2b-663d-45f3-b99d-9ed1169bb091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba9be2b-663d-45f3-b99d-9ed1169bb091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef1e366-db9d-45e1-b3a1-48e28169c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Volume ab26eaf3-8259-4043-adc5-f77d0557b905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab26eaf3-8259-4043-adc5-f77d0557b905', 'volume_size': 1} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=180a0433-94b2-4a3a-8a59-aeac4ba2f253,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1400623025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=180a0433-94b2-4a3a-8a59-aeac4ba2f253,host='devstack@QuobyteHD#QuobyteHD',id=ab26eaf3-8259-4043-adc5-f77d0557b905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b545bf6b69d40b1b7a44bf1a33062e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='e242e8d4c2824ffba3cae839ff16b210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(692592f7-462f-418a-aa44-cf348017a5c9),volume_type_id=692592f7-462f-418a-aa44-cf348017a5c9)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Creating volume ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:23 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 1073741824 Apr 15 10:10:23 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Flow 'volume_create_manager' (74c1918b-d128-468a-9398-dbe9d6886c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae49e56a-b19e-4aa1-8571-01b439c7effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae49e56a-b19e-4aa1-8571-01b439c7effe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1945285800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f946aa9-2bad-489f-af6e-c7d0f24565ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38543428bbc845dc97095825847bca0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='a8473d849840444ea4b463b078ff32e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffa1daf-dc2d-42ac-bb58-73828d35d39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffa1daf-dc2d-42ac-bb58-73828d35d39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda4f0ba-461d-437c-ae6c-6dc7fa4107ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda4f0ba-461d-437c-ae6c-6dc7fa4107ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f946aa9-2bad-489f-af6e-c7d0f24565ae', 'volume_name': 'volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fe8fb5-d50b-46ec-bebf-7a99b4fae6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fe8fb5-d50b-46ec-bebf-7a99b4fae6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a8dc2e-5804-4f2c-a0d6-3d734116e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Volume 9f946aa9-2bad-489f-af6e-c7d0f24565ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae', 'volume_size': 1} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:24 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 1073741824" returned: 0 in 0.667s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[84619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 Apr 15 10:10:24 devstack sudo[84619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack sudo[84619]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905" returned: 0 in 0.527s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1945285800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f946aa9-2bad-489f-af6e-c7d0f24565ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38543428bbc845dc97095825847bca0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:24Z,use_quota=True,user_id='a8473d849840444ea4b463b078ff32e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Creating volume 9f946aa9-2bad-489f-af6e-c7d0f24565ae {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:25 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef1e366-db9d-45e1-b3a1-48e28169c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab26eaf3-8259-4043-adc5-f77d0557b905', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae 1073741824 Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3cf462-af27-4fcf-8f59-cd5aa54bc30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Volume volume-ab26eaf3-8259-4043-adc5-f77d0557b905 (ab26eaf3-8259-4043-adc5-f77d0557b905): created successfully Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3cf462-af27-4fcf-8f59-cd5aa54bc30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Flow 'volume_create_manager' (9177a997-8fb1-46c5-b457-b6c4e1f424bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f8fe779a-3df7-485b-a9af-48a0415c006c tempest-GroupSnapshotsV319Test-602797567 None] Created volume successfully. Apr 15 10:10:26 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae 1073741824" returned: 0 in 0.893s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[84651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae Apr 15 10:10:26 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] GroupSnapshot 7e591de6-7360-4c5e-95eb-dbfa1d4afbb4: creating. Apr 15 10:10:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Group snapshot 7e591de6-7360-4c5e-95eb-dbfa1d4afbb4: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:10:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:26 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae" returned: 0 in 0.971s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.205s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a8dc2e-5804-4f2c-a0d6-3d734116e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe71d975-c3e4-4f18-9ef1-cc50f309daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Volume volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae (9f946aa9-2bad-489f-af6e-c7d0f24565ae): created successfully Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe71d975-c3e4-4f18-9ef1-cc50f309daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Flow 'volume_create_manager' (74c1918b-d128-468a-9398-dbe9d6886c45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Creating offline snapshot b92f0b63-49ae-4bee-b6b6-c939780f711d of volume ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9d7ef645-7a8a-479d-9c00-5314aec57bb9 tempest-ServersNegativeTestJSON-395576179 None] Created volume successfully. Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7577306c-8b60-4943-8d99-d8b90c6354e1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack sudo[84654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 Apr 15 10:10:27 devstack sudo[84654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "cinder-9f946aa9-2bad-489f-af6e-c7d0f24565ae-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-9f946aa9-2bad-489f-af6e-c7d0f24565ae-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:28 devstack sudo[84654]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905" returned: 0 in 1.055s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[84694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d 1G Apr 15 10:10:28 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "cinder-quobyte-9f946aa9-2bad-489f-af6e-c7d0f24565ae" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-quobyte-9f946aa9-2bad-489f-af6e-c7d0f24565ae" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44814f17-714b-48cb-a5a1-50756ac04727]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae Apr 15 10:10:28 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d 1G" returned: 0 in 0.885s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab26eaf3-8259-4043-adc5-f77d0557b905 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab26eaf3-8259-4043-adc5-f77d0557b905 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d Apr 15 10:10:29 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae" returned: 0 in 0.874s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae Apr 15 10:10:29 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab26eaf3-8259-4043-adc5-f77d0557b905 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d" returned: 0 in 0.730s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[84713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d Apr 15 10:10:29 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f946aa9-2bad-489f-af6e-c7d0f24565ae" returned: 0 in 0.717s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-quobyte-9f946aa9-2bad-489f-af6e-c7d0f24565ae" released by "delete_volume" :: held 1.626s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:29 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Created reservations ['748107d5-9d10-410b-bf00-e8d1ae5cccfe', '11afabbf-16a4-4ab0-97de-379eb8815e8e', '9bdda13b-ae4e-4e94-be07-0c3fb9dc84a1', '9563af7d-dd8f-4a31-a82c-1c359c53d789'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[84715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:30 devstack sudo[84715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "cinder-46304127-748a-4f68-8563-6ce8106922cf-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-46304127-748a-4f68-8563-6ce8106922cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "cinder-quobyte-46304127-748a-4f68-8563-6ce8106922cf" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-quobyte-46304127-748a-4f68-8563-6ce8106922cf" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7909c6a-233f-4edd-9f3f-85ac0bc0623b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d" returned: 0 in 0.897s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[84720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.info Apr 15 10:10:30 devstack sudo[84720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack sudo[84718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf Apr 15 10:10:30 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack sudo[84715]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.103s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Deleted volume successfully. Apr 15 10:10:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-abbe39d3-c6f2-4fd2-b740-d2aaf139514f tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-9f946aa9-2bad-489f-af6e-c7d0f24565ae-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:31 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf" returned: 0 in 1.055s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf Apr 15 10:10:31 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack sudo[84720]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.info" returned: 0 in 1.056s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.info Apr 15 10:10:31 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.info" returned: 0 in 0.545s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.282s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8bda1b5d-b726-4872-b94d-ba5c3da17b38 tempest-GroupSnapshotsV319Test-602797567 None] group_snapshot 7e591de6-7360-4c5e-95eb-dbfa1d4afbb4: created successfully Apr 15 10:10:32 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46304127-748a-4f68-8563-6ce8106922cf" returned: 0 in 0.750s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-quobyte-46304127-748a-4f68-8563-6ce8106922cf" released by "delete_volume" :: held 1.840s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Created reservations ['40f8d70d-29a4-423a-aa0c-ea40fd79066c', '92078689-448c-4515-a70b-083186d68b14', 'aa0fbcf5-8e6c-43a8-9e19-3797183b9c7a', 'b0c2401b-0494-4243-b6bc-a09eacafd115'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[84740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:32 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.809s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Deleted volume successfully. Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e074e2d3-5ee8-4aeb-aecd-447bbdf984cb tempest-ServersNegativeTestJSON-395576179 None] Lock "cinder-46304127-748a-4f68-8563-6ce8106922cf-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:33 devstack sudo[84744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:33 devstack sudo[84744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] group_snapshot 7e591de6-7360-4c5e-95eb-dbfa1d4afbb4: deleting Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] group_snapshot 7e591de6-7360-4c5e-95eb-dbfa1d4afbb4: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Acquiring lock "cinder-quobyte-ab26eaf3-8259-4043-adc5-f77d0557b905" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Lock "cinder-quobyte-ab26eaf3-8259-4043-adc5-f77d0557b905" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Acquiring lock "cinder-quobyte-b92f0b63-49ae-4bee-b6b6-c939780f711d" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Lock "cinder-quobyte-b92f0b63-49ae-4bee-b6b6-c939780f711d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Deleting offline snapshot b92f0b63-49ae-4bee-b6b6-c939780f711d of volume ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] snapshot_file for this snap is: volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7460b26a-c2ac-49ce-8d6b-c59817bba086]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[84746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d Apr 15 10:10:34 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack sudo[84744]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.828s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:34 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d" returned: 0 in 0.983s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab26eaf3-8259-4043-adc5-f77d0557b905(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13a64fc-8866-4836-b5dd-5f4bb1153901]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[84776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 Apr 15 10:10:34 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905" returned: 0 in 0.696s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[84784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d Apr 15 10:10:35 devstack sudo[84784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:36 devstack sudo[84784]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d" returned: 0 in 0.724s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:36 devstack sudo[84789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d Apr 15 10:10:36 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:36 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905.b92f0b63-49ae-4bee-b6b6-c939780f711d" returned: 0 in 0.702s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Lock "cinder-quobyte-b92f0b63-49ae-4bee-b6b6-c939780f711d" released by "_delete_snapshot" :: held 3.200s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Lock "cinder-quobyte-ab26eaf3-8259-4043-adc5-f77d0557b905" released by "delete_snapshot" :: held 3.230s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:37 devstack cinder-volume[82850]: WARNING cinder.quota [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-103846851 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-103846851, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:37 devstack cinder-volume[82850]: WARNING cinder.quota [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-103846851 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-103846851, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] Created reservations ['9d149f57-230e-4617-a854-3ec1e1cf8d88', 'da25b925-360f-4db2-9f4f-568f7cc23e3d', 'a1639c9b-4111-43d2-8a2b-6ec5b607949f', '6566f39f-7eb0-4435-ae1c-fd67153b961b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-47aadd04-707e-4ee2-810a-0a92e51db599 tempest-GroupSnapshotsV319Test-602797567 None] group_snapshot 7e591de6-7360-4c5e-95eb-dbfa1d4afbb4: deleted successfully Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Flow 'volume_create_manager' (ec6c7830-4475-4c0c-abc4-ef1a61315d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a57387-4708-4bfb-982e-c833382da8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a57387-4708-4bfb-982e-c833382da8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:37Z,deleted=False,deleted_at=None,display_description='',display_name='679c0642-ad6d-44f1-b88a-4fcc3d3c17c1-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fdc0f9-62bf-4aab-9f07-e441dca95e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165de80652f645279321ba2d552f7b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:38Z,use_quota=True,user_id='22772adf7b074ffab8a504ea5f100813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e3784d-9360-4892-9e2c-05879397df0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e3784d-9360-4892-9e2c-05879397df0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f0e350-811d-4ae9-853c-176950f45a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f0e350-811d-4ae9-853c-176950f45a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28fdc0f9-62bf-4aab-9f07-e441dca95e99', 'volume_name': 'volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0be9bb5-c6d7-4715-a7a6-5a2c6e5191c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0be9bb5-c6d7-4715-a7a6-5a2c6e5191c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dc90f9-6026-48fb-80ad-0947cc26800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:37 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Volume 28fdc0f9-62bf-4aab-9f07-e441dca95e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99', 'volume_size': 1} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:37Z,deleted=False,deleted_at=None,display_description='',display_name='679c0642-ad6d-44f1-b88a-4fcc3d3c17c1-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28fdc0f9-62bf-4aab-9f07-e441dca95e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165de80652f645279321ba2d552f7b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:38Z,use_quota=True,user_id='22772adf7b074ffab8a504ea5f100813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Creating volume 28fdc0f9-62bf-4aab-9f07-e441dca95e99 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:37 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:37 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 1073741824 Apr 15 10:10:37 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Acquiring lock "cinder-quobyte-ab26eaf3-8259-4043-adc5-f77d0557b905" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Lock "cinder-quobyte-ab26eaf3-8259-4043-adc5-f77d0557b905" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0795beb6-1b87-4653-aff8-bcd26f2e8428]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 1073741824" returned: 0 in 1.107s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:38 devstack sudo[84802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 Apr 15 10:10:38 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[84804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 Apr 15 10:10:38 devstack sudo[84804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905" returned: 0 in 0.617s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:39 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905 Apr 15 10:10:39 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack sudo[84804]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99" returned: 0 in 0.777s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dc90f9-6026-48fb-80ad-0947cc26800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8646d01f-676f-4e20-bc35-b1db0e4d9442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Volume volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 (28fdc0f9-62bf-4aab-9f07-e441dca95e99): created successfully Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8646d01f-676f-4e20-bc35-b1db0e4d9442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Flow 'volume_create_manager' (ec6c7830-4475-4c0c-abc4-ef1a61315d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-4a6df2ad-a747-4177-9994-6e16a166a870 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Created volume successfully. Apr 15 10:10:40 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ab26eaf3-8259-4043-adc5-f77d0557b905" returned: 0 in 0.851s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Lock "cinder-quobyte-ab26eaf3-8259-4043-adc5-f77d0557b905" released by "delete_volume" :: held 1.537s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Created reservations ['c0f40f2e-2633-471c-8a82-af112b46ce5e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:40 devstack cinder-volume[82850]: WARNING cinder.quota [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-103846851 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-103846851, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Created reservations ['2d6fdcf0-6922-4c26-86af-41f76c4c5429', '1908a0a6-f00f-41fd-bb5b-d6eb979626af', 'e2c7ac97-4fe9-4d3c-98ea-1134a53368e4', '45889bab-d286-486c-8361-e02683cc6818'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:40 devstack sudo[84813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:10:40 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:40 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.632s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:40 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-63b9bfec-4dec-481a-8cfe-16671bf624e2 tempest-GroupSnapshotsV319Test-602797567 None] Delete group completed successfully. Apr 15 10:10:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-49ad9d21-419c-4881-9116-4459335fe133 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-49ad9d21-419c-4881-9116-4459335fe133 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea9b996-bc48-4759-8053-b6648a690dbe]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-49ad9d21-419c-4881-9116-4459335fe133 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:41 devstack sudo[84825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 Apr 15 10:10:41 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:42 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-49ad9d21-419c-4881-9116-4459335fe133 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99" returned: 0 in 1.037s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-49ad9d21-419c-4881-9116-4459335fe133 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.060s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-49ad9d21-419c-4881-9116-4459335fe133 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383', 'name': 'volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd35001fb-afcc-4003-818c-a70145e80401', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:10:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-404ecd4e-0e34-43ce-8f39-353f72691717 req-49ad9d21-419c-4881-9116-4459335fe133 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] attachment_update completed successfully. Apr 15 10:10:52 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=84,cinder:UPDATE=85,cinder:INSERT=22,cinder:DELETE=5 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:52 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=62,cinder:INSERT=19,cinder:UPDATE=96,cinder:DELETE=8 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b56639f2-f136-48cf-b2c5-489810f2861d tempest-GroupsTest-297753936 None] Group tempest-Group1-1924828891: creating Apr 15 10:10:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b56639f2-f136-48cf-b2c5-489810f2861d tempest-GroupsTest-297753936 None] Group tempest-Group1-1924828891: created successfully Apr 15 10:10:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b56639f2-f136-48cf-b2c5-489810f2861d tempest-GroupsTest-297753936 None] Create group completed successfully. Apr 15 10:10:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b2d3e1fb-91d5-4234-bc75-f79fafb94d0c tempest-GroupsTest-297753936 None] Group tempest-Group2-1152996670: creating Apr 15 10:10:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b2d3e1fb-91d5-4234-bc75-f79fafb94d0c tempest-GroupsTest-297753936 None] Group tempest-Group2-1152996670: created successfully Apr 15 10:10:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b2d3e1fb-91d5-4234-bc75-f79fafb94d0c tempest-GroupsTest-297753936 None] Create group completed successfully. Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Flow 'volume_create_manager' (84201b4a-3b93-41eb-a6e6-8626130febe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8eeaeb-15aa-4221-b768-32d96551d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8eeaeb-15aa-4221-b768-32d96551d07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519954144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83037249-ad0e-49a0-9220-611b2115117e,host='devstack@QuobyteHD#QuobyteHD',id=61e06b70-9a9f-4669-8dd9-1638ea3011f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a42d709ab419a9e0e956188a4c6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:56Z,use_quota=True,user_id='32647d5a078848acac04afa709479fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44c89aae-eddf-4278-b2bf-a03846aea61a),volume_type_id=44c89aae-eddf-4278-b2bf-a03846aea61a)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99a85ef-e98f-4276-a1ad-c4744ec2df20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99a85ef-e98f-4276-a1ad-c4744ec2df20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e303f34-a7ad-46ac-8db9-394d086ba473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e303f34-a7ad-46ac-8db9-394d086ba473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e06b70-9a9f-4669-8dd9-1638ea3011f6', 'volume_name': 'volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76825e64-5f5c-4bde-8965-8ab304e38347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76825e64-5f5c-4bde-8965-8ab304e38347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e1e963-6857-46e6-8815-541ffca92241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Volume 61e06b70-9a9f-4669-8dd9-1638ea3011f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6', 'volume_size': 1} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83037249-ad0e-49a0-9220-611b2115117e,created_at=2026-04-15T08:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519954144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83037249-ad0e-49a0-9220-611b2115117e,host='devstack@QuobyteHD#QuobyteHD',id=61e06b70-9a9f-4669-8dd9-1638ea3011f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a42d709ab419a9e0e956188a4c6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:56Z,use_quota=True,user_id='32647d5a078848acac04afa709479fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44c89aae-eddf-4278-b2bf-a03846aea61a),volume_type_id=44c89aae-eddf-4278-b2bf-a03846aea61a)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Creating volume 61e06b70-9a9f-4669-8dd9-1638ea3011f6 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:56 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:10:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:56 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 1073741824 Apr 15 10:10:56 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:57 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 1073741824" returned: 0 in 0.924s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:57 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 Apr 15 10:10:57 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:58 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6" returned: 0 in 0.837s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e1e963-6857-46e6-8815-541ffca92241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e5f4e6-a565-4528-8794-1b708051aa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Volume volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 (61e06b70-9a9f-4669-8dd9-1638ea3011f6): created successfully Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e5f4e6-a565-4528-8794-1b708051aa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Flow 'volume_create_manager' (84201b4a-3b93-41eb-a6e6-8626130febe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a39e992b-ba08-42c6-a9ba-0cb1460e8cb5 tempest-GroupsV320Test-373042939 None] Group tempest-GroupsV320Test-Group-1762702405: creating Apr 15 10:10:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-df5d566b-9a99-4e00-be08-426efb776749 tempest-GroupsTest-297753936 None] Created volume successfully. Apr 15 10:10:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a39e992b-ba08-42c6-a9ba-0cb1460e8cb5 tempest-GroupsV320Test-373042939 None] Group tempest-GroupsV320Test-Group-1762702405: created successfully Apr 15 10:10:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a39e992b-ba08-42c6-a9ba-0cb1460e8cb5 tempest-GroupsV320Test-373042939 None] Create group completed successfully. Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Acquiring lock "cinder-quobyte-61e06b70-9a9f-4669-8dd9-1638ea3011f6" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Lock "cinder-quobyte-61e06b70-9a9f-4669-8dd9-1638ea3011f6" acquired by "delete_volume" :: waited 0.028s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbc9ea8-4895-4bae-be63-51bae5de8f82]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack sudo[85275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 Apr 15 10:10:59 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6" returned: 0 in 0.965s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6 Apr 15 10:10:59 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Created reservations ['aa4ec497-5a6a-4d12-a537-127f3a46a453'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:00 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:00 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:00 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-61e06b70-9a9f-4669-8dd9-1638ea3011f6" returned: 0 in 0.604s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Lock "cinder-quobyte-61e06b70-9a9f-4669-8dd9-1638ea3011f6" released by "delete_volume" :: held 1.602s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Created reservations ['e5da6a48-5a90-4184-8a42-072568160a41'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:00 devstack cinder-volume[82850]: WARNING cinder.quota [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1429796862 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1429796862, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:00 devstack cinder-volume[82850]: WARNING cinder.quota [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1429796862 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1429796862, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Created reservations ['d9d5c7d7-dfbf-48a9-9404-3ec8763dfa21', '5f2d0415-b646-46db-a771-031f524d06a4', 'c60d56ad-fb0c-4ad1-8dd1-1153eb00b603', '2fb62e96-6f5f-47aa-96c8-671632c2b9f4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:00 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.725s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e5dd0324-f96d-4092-a950-a975f23bda0d tempest-GroupsV320Test-373042939 None] Delete group completed successfully. Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:00 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:00 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Created reservations ['d9a22fad-0547-468e-9347-617c13b13441'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:01 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:01 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.899s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-330fbb7b-e28e-406d-ba5d-cb52c49bff9b tempest-GroupsTest-297753936 None] Delete group completed successfully. Apr 15 10:11:02 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.825s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ff304794-143c-4195-8bbe-a7f922a2c457 tempest-GroupsTest-297753936 None] Delete group completed successfully. Apr 15 10:11:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f0919aa6-af8e-4fad-a7ed-ed0ccdcafa0b tempest-GroupsTest-297753936 None] Group tempest-GroupsTest-Group-2118148892: creating Apr 15 10:11:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f0919aa6-af8e-4fad-a7ed-ed0ccdcafa0b tempest-GroupsTest-297753936 None] Group tempest-GroupsTest-Group-2118148892: created successfully Apr 15 10:11:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f0919aa6-af8e-4fad-a7ed-ed0ccdcafa0b tempest-GroupsTest-297753936 None] Create group completed successfully. Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Flow 'volume_create_manager' (84a26b38-644f-4970-9967-52600c43b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc875df-5e2f-4b97-8e4f-a7e52dc36f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc875df-5e2f-4b97-8e4f-a7e52dc36f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389879857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb538680-4b8d-431f-a31d-c919ac798135,host='devstack@QuobyteHD#QuobyteHD',id=cff0ce79-0974-49f3-a768-d9e2172e0041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a42d709ab419a9e0e956188a4c6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:04Z,use_quota=True,user_id='32647d5a078848acac04afa709479fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(346a5125-d039-4c2c-aa45-73456395779a),volume_type_id=346a5125-d039-4c2c-aa45-73456395779a)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3485a9b-3aba-45a6-8fa7-7a8373852701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3485a9b-3aba-45a6-8fa7-7a8373852701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea07fec-ee4d-4630-a553-0ddff6ca71d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea07fec-ee4d-4630-a553-0ddff6ca71d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff0ce79-0974-49f3-a768-d9e2172e0041', 'volume_name': 'volume-cff0ce79-0974-49f3-a768-d9e2172e0041', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78277e29-24fa-483a-a2ba-1f07fd58142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78277e29-24fa-483a-a2ba-1f07fd58142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a36fd03-68ed-435d-a0ea-173171232a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Volume cff0ce79-0974-49f3-a768-d9e2172e0041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff0ce79-0974-49f3-a768-d9e2172e0041', 'volume_size': 1} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb538680-4b8d-431f-a31d-c919ac798135,created_at=2026-04-15T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-389879857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb538680-4b8d-431f-a31d-c919ac798135,host='devstack@QuobyteHD#QuobyteHD',id=cff0ce79-0974-49f3-a768-d9e2172e0041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a42d709ab419a9e0e956188a4c6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:04Z,use_quota=True,user_id='32647d5a078848acac04afa709479fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(346a5125-d039-4c2c-aa45-73456395779a),volume_type_id=346a5125-d039-4c2c-aa45-73456395779a)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Creating volume cff0ce79-0974-49f3-a768-d9e2172e0041 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:04 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 1073741824 Apr 15 10:11:04 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 1073741824" returned: 0 in 0.688s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[85345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 Apr 15 10:11:05 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041" returned: 0 in 0.618s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a36fd03-68ed-435d-a0ea-173171232a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff0ce79-0974-49f3-a768-d9e2172e0041', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbae39a1-4db2-4fb4-a6f7-5dfb42e2b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Volume volume-cff0ce79-0974-49f3-a768-d9e2172e0041 (cff0ce79-0974-49f3-a768-d9e2172e0041): created successfully Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbae39a1-4db2-4fb4-a6f7-5dfb42e2b321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Flow 'volume_create_manager' (84a26b38-644f-4970-9967-52600c43b44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5becde7b-28bc-40d8-80a6-4f7fdc8f9295 tempest-GroupsTest-297753936 None] Created volume successfully. Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Flow 'volume_create_manager' (51b1e437-5dd6-45d4-b60f-d77589fb91ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446cbc5f-1af2-4d81-9410-07c053c53a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (446cbc5f-1af2-4d81-9410-07c053c53a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-704462831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7510a466-3478-4c3b-b9fd-a297ceadf73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7766900ec234f8c86d93697c5463fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:06Z,use_quota=True,user_id='7d34021fef7045c59e943808235a2d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae88951-816c-4e19-8b43-3fa521d77ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae88951-816c-4e19-8b43-3fa521d77ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc406f9-cbef-4e2f-adec-c7340426e10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc406f9-cbef-4e2f-adec-c7340426e10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7510a466-3478-4c3b-b9fd-a297ceadf73c', 'volume_name': 'volume-7510a466-3478-4c3b-b9fd-a297ceadf73c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478d5c57-38fc-4909-b06c-0801b8ce7876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478d5c57-38fc-4909-b06c-0801b8ce7876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62095ca2-fdc6-40da-91fa-0bd2768a80ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:06 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Volume 7510a466-3478-4c3b-b9fd-a297ceadf73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7510a466-3478-4c3b-b9fd-a297ceadf73c', 'volume_size': 1} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-704462831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7510a466-3478-4c3b-b9fd-a297ceadf73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7766900ec234f8c86d93697c5463fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:06Z,use_quota=True,user_id='7d34021fef7045c59e943808235a2d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Creating volume 7510a466-3478-4c3b-b9fd-a297ceadf73c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:06 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:06 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c 1073741824 Apr 15 10:11:06 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Flow 'volume_create_manager' (3e5c42f4-e309-40d8-a2f0-b547ab6cb234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a301103-3183-4c81-8ec5-b70de0ef73e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a301103-3183-4c81-8ec5-b70de0ef73e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225558528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb538680-4b8d-431f-a31d-c919ac798135,host='devstack@QuobyteHD#QuobyteHD',id=9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a42d709ab419a9e0e956188a4c6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:07Z,use_quota=True,user_id='32647d5a078848acac04afa709479fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(346a5125-d039-4c2c-aa45-73456395779a),volume_type_id=346a5125-d039-4c2c-aa45-73456395779a)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef8a330-c425-474e-8d6f-61267eac9da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef8a330-c425-474e-8d6f-61267eac9da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821a97f6-5bd3-4060-8c6d-5b54648ee95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821a97f6-5bd3-4060-8c6d-5b54648ee95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4', 'volume_name': 'volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0a30e-2190-4270-87ab-2ea9185647cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0a30e-2190-4270-87ab-2ea9185647cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9f3448-422b-495b-b03c-740a464025bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Volume 9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4', 'volume_size': 1} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c 1073741824" returned: 0 in 0.972s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:07 devstack sudo[85357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c Apr 15 10:11:07 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:07 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c" returned: 0 in 0.610s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb538680-4b8d-431f-a31d-c919ac798135,created_at=2026-04-15T08:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225558528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb538680-4b8d-431f-a31d-c919ac798135,host='devstack@QuobyteHD#QuobyteHD',id=9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd3a42d709ab419a9e0e956188a4c6dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:07Z,use_quota=True,user_id='32647d5a078848acac04afa709479fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(346a5125-d039-4c2c-aa45-73456395779a),volume_type_id=346a5125-d039-4c2c-aa45-73456395779a)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Creating volume 9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:07 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62095ca2-fdc6-40da-91fa-0bd2768a80ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7510a466-3478-4c3b-b9fd-a297ceadf73c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda1861a-cd28-4ff3-ac09-84dc827aeeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Volume volume-7510a466-3478-4c3b-b9fd-a297ceadf73c (7510a466-3478-4c3b-b9fd-a297ceadf73c): created successfully Apr 15 10:11:07 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 1073741824 Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda1861a-cd28-4ff3-ac09-84dc827aeeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:07 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Flow 'volume_create_manager' (51b1e437-5dd6-45d4-b60f-d77589fb91ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e34a3904-452b-4cbf-8b33-bfa7fda821fc tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Created volume successfully. Apr 15 10:11:09 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 1073741824" returned: 0 in 1.385s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:09 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 Apr 15 10:11:09 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Acquiring lock "cinder-7510a466-3478-4c3b-b9fd-a297ceadf73c-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "cinder-7510a466-3478-4c3b-b9fd-a297ceadf73c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Acquiring lock "cinder-quobyte-7510a466-3478-4c3b-b9fd-a297ceadf73c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "cinder-quobyte-7510a466-3478-4c3b-b9fd-a297ceadf73c" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c2dcd-b0e3-4a8d-a6f4-4b7badb879bb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:09 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c Apr 15 10:11:09 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:10 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4" returned: 0 in 0.880s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9f3448-422b-495b-b03c-740a464025bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c3847-2e1a-45e1-8334-aab5c981b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Volume volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 (9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4): created successfully Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c3847-2e1a-45e1-8334-aab5c981b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Flow 'volume_create_manager' (3e5c42f4-e309-40d8-a2f0-b547ab6cb234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4b426731-03ee-4a55-a0a3-1015a76a6ea6 tempest-GroupsTest-297753936 None] Created volume successfully. Apr 15 10:11:10 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c" returned: 0 in 0.620s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:10 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c Apr 15 10:11:10 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dd1cc9db-9208-493a-8731-94f34e17e9d4 tempest-GroupsTest-297753936 None] Update group completed successfully. Apr 15 10:11:11 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7510a466-3478-4c3b-b9fd-a297ceadf73c" returned: 0 in 0.706s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "cinder-quobyte-7510a466-3478-4c3b-b9fd-a297ceadf73c" released by "delete_volume" :: held 1.369s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Created reservations ['87b11dc8-1c94-4b7d-8ef7-6ed6ab7a247b', '04dd4a97-9274-49a6-8be4-782f7a231688', 'ebf26f24-f5d3-435d-9039-281ed392a10d', '0e2e25e7-a45b-4c5e-a7b3-91abec789e0d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:11 devstack sudo[85450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:11 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:11 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.545s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Deleted volume successfully. Apr 15 10:11:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-df124d47-c88e-4071-b478-7acf3ac2f7e7 tempest-VolumeQuotasNegativeTestJSON-1858634448 None] Lock "cinder-7510a466-3478-4c3b-b9fd-a297ceadf73c-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9cca950b-ab38-45a5-9c78-8f17592f490c tempest-GroupsTest-297753936 None] Update group completed successfully. Apr 15 10:11:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Acquiring lock "cinder-quobyte-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Lock "cinder-quobyte-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:13 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2ed885-d197-44e9-b27d-66253970b81b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:13 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 Apr 15 10:11:13 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:14 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4" returned: 0 in 0.924s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:14 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4 Apr 15 10:11:14 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:14 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4" returned: 0 in 0.668s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Lock "cinder-quobyte-9d5db1a3-acea-4a69-bdb0-434cf2e0cfe4" released by "delete_volume" :: held 1.637s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Acquiring lock "cinder-quobyte-cff0ce79-0974-49f3-a768-d9e2172e0041" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Lock "cinder-quobyte-cff0ce79-0974-49f3-a768-d9e2172e0041" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe433b6-134c-40bf-8872-c3e4264918a0]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:15 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 Apr 15 10:11:15 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:15 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041" returned: 0 in 0.794s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:15 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041 Apr 15 10:11:15 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:16 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-cff0ce79-0974-49f3-a768-d9e2172e0041" returned: 0 in 0.756s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Lock "cinder-quobyte-cff0ce79-0974-49f3-a768-d9e2172e0041" released by "delete_volume" :: held 1.607s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:16 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Created reservations ['f30d9d9c-ef92-4f6b-9487-226d19f91d91'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:16 devstack cinder-volume[82850]: WARNING cinder.quota [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2033057628 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2033057628, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:16 devstack cinder-volume[82850]: WARNING cinder.quota [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2033057628 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2033057628, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:16 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Created reservations ['37dbf861-74b5-42cd-8a25-ce2bb8f9bce0', '1324b008-e835-446e-b2e2-94c5b5ad7e27', 'ebca433b-6c87-400a-b286-473775f63b9b', '3457daac-16e7-437f-8529-dfd7c8b245be'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:16 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Created reservations ['e7d9aabf-f127-436b-a5fd-91209a662471', '2489dbe2-0b9f-49b8-ae06-0606e0b2dc93', 'd7e0eff5-1a4e-447c-9637-6ac7c3f51641', 'fef8d5d9-20f1-4e82-9fcc-79a732ea6a88'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:17 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:17 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (474b3a2b-d358-4c58-ad8a-ba602a564173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd522dd-589e-443c-9833-d660af9624fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd522dd-589e-443c-9833-d660af9624fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675225736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab254b0-6907-40f0-a0b2-ac0e8c87a954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:17Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f7e18d-ebca-44f9-a121-8f34b0b5ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f7e18d-ebca-44f9-a121-8f34b0b5ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b4c26e-2293-453e-acea-6f01445e9849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b4c26e-2293-453e-acea-6f01445e9849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab254b0-6907-40f0-a0b2-ac0e8c87a954', 'volume_name': 'volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98e9a1-e33f-4d78-969a-0b00818c3fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98e9a1-e33f-4d78-969a-0b00818c3fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83eee98-6d5a-4cc6-aa04-3a69f04db4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Volume eab254b0-6907-40f0-a0b2-ac0e8c87a954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954', 'volume_size': 1} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675225736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab254b0-6907-40f0-a0b2-ac0e8c87a954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:17Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Creating volume eab254b0-6907-40f0-a0b2-ac0e8c87a954 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:17 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:17 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 1073741824 Apr 15 10:11:17 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:18 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.196s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c1f08d7b-e939-408a-8f84-abea0cdc0695 tempest-GroupsTest-297753936 None] Delete group completed successfully. Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Flow 'volume_create_manager' (eb2ba623-ab88-4062-9ddd-4012cb94af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c33204c-879c-406a-93e9-e3a1bcc08b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c33204c-879c-406a-93e9-e3a1bcc08b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-93048805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d4306e-5226-45e7-8f23-e67290dea341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9cae109099459b86e1f630001c0600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:18Z,use_quota=True,user_id='1b91913419ff4a6a8ccb1650e46232b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41772298-bd6c-46ff-a8e4-ca0bd737d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41772298-bd6c-46ff-a8e4-ca0bd737d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bba1024-b1ec-4dfc-affe-e7ca7ffa1a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG cinder.image.glance [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Creating Keystone auth plugin from conf {{(pid=82850) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:11:18 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 1073741824" returned: 0 in 1.144s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:18 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 Apr 15 10:11:18 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bba1024-b1ec-4dfc-affe-e7ca7ffa1a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98d4306e-5226-45e7-8f23-e67290dea341', 'volume_name': 'volume-98d4306e-5226-45e7-8f23-e67290dea341', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b21479-5c9e-4d94-8067-14cbf5cc90dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b21479-5c9e-4d94-8067-14cbf5cc90dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d3b03b-9b8b-44ec-b072-65ac815be9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Volume 98d4306e-5226-45e7-8f23-e67290dea341: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98d4306e-5226-45e7-8f23-e67290dea341', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Trying to clone 98d4306e-5226-45e7-8f23-e67290dea341 from image 019e5b32-dfb6-4970-afa1-ec198cc6628d at location (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:11:19 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954" returned: 0 in 0.804s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83eee98-6d5a-4cc6-aa04-3a69f04db4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0883e42-ea95-4309-84d7-dcf182b179bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Volume volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 (eab254b0-6907-40f0-a0b2-ac0e8c87a954): created successfully Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0883e42-ea95-4309-84d7-dcf182b179bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (474b3a2b-d358-4c58-ad8a-ba602a564173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-29038802-3998-41ac-a189-f40282658e51 tempest-VolumesActionsTest-1729292014 None] Created volume successfully. Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:11:19 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3476ce01-0bfa-4c36-8340-b7ccf03d2aba]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:19 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD Apr 15 10:11:19 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:20 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD" returned: 0 in 0.644s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:20 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d is fetched for user 1b91913419ff4a6a8ccb1650e46232b4. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:11:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48e9ed4-5b9f-471b-b6f4-e656eb591f43]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:20 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD Apr 15 10:11:20 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61bf2d58-3f96-4fdc-b78c-3b639d04afcf tempest-VolumesActionsTest-1729292014 None] Acquiring lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954" by "attach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61bf2d58-3f96-4fdc-b78c-3b639d04afcf tempest-VolumesActionsTest-1729292014 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954" acquired by "attach_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-61bf2d58-3f96-4fdc-b78c-3b639d04afcf tempest-VolumesActionsTest-1729292014 None] Attaching volume eab254b0-6907-40f0-a0b2-ac0e8c87a954 to instance b22d97d4-dbdd-43cc-84d5-b70cb8da6fe1 at mountpoint /dev/vdb on host None. Apr 15 10:11:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-61bf2d58-3f96-4fdc-b78c-3b639d04afcf tempest-VolumesActionsTest-1729292014 None] Attach volume completed successfully. Apr 15 10:11:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61bf2d58-3f96-4fdc-b78c-3b639d04afcf tempest-VolumesActionsTest-1729292014 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954" released by "attach_volume" :: held 0.122s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:21 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-93048805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d4306e-5226-45e7-8f23-e67290dea341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb9cae109099459b86e1f630001c0600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:18Z,use_quota=True,user_id='1b91913419ff4a6a8ccb1650e46232b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Creating volume 98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:21 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:21 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 1073741824 Apr 15 10:11:21 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f2491f23-dc62-4d52-8f37-31d3718b15df tempest-VolumesActionsTest-806879594 None] Terminate volume connection completed successfully. Apr 15 10:11:22 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 1073741824" returned: 0 in 1.061s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:22 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 Apr 15 10:11:22 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f2491f23-dc62-4d52-8f37-31d3718b15df tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f2491f23-dc62-4d52-8f37-31d3718b15df tempest-VolumesActionsTest-806879594 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f2491f23-dc62-4d52-8f37-31d3718b15df tempest-VolumesActionsTest-806879594 None] Detaching volume eab254b0-6907-40f0-a0b2-ac0e8c87a954 from instance b22d97d4-dbdd-43cc-84d5-b70cb8da6fe1. Apr 15 10:11:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f2491f23-dc62-4d52-8f37-31d3718b15df tempest-VolumesActionsTest-806879594 None] Detach volume completed successfully. Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f2491f23-dc62-4d52-8f37-31d3718b15df tempest-VolumesActionsTest-806879594 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:22 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341" returned: 0 in 0.727s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Attempting download of 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 98d4306e-5226-45e7-8f23-e67290dea341. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[60509bcc-da8d-47f0-91de-940dbd8a056e]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_s9amp5_j {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:23 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_s9amp5_j Apr 15 10:11:23 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9963d040-f63f-49dd-b1a7-2fe7e0fdb570 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9963d040-f63f-49dd-b1a7-2fe7e0fdb570 tempest-VolumesActionsTest-1729292014 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9963d040-f63f-49dd-b1a7-2fe7e0fdb570 tempest-VolumesActionsTest-1729292014 None] Volume detach called, but volume not attached. Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9963d040-f63f-49dd-b1a7-2fe7e0fdb570 tempest-VolumesActionsTest-1729292014 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-84ca7f41-ccb1-4b0d-a607-2899de4740a6 tempest-GroupsV314Test-1683524499 None] Group tempest-GroupsV314Test-Group-1584992982: creating Apr 15 10:11:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-84ca7f41-ccb1-4b0d-a607-2899de4740a6 tempest-GroupsV314Test-1683524499 None] Group tempest-GroupsV314Test-Group-1584992982: created successfully Apr 15 10:11:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-84ca7f41-ccb1-4b0d-a607-2899de4740a6 tempest-GroupsV314Test-1683524499 None] Create group completed successfully. Apr 15 10:11:23 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_s9amp5_j" returned: 0 in 0.858s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_s9amp5_j {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_s9amp5_j Apr 15 10:11:24 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "cinder-quobyte-eab254b0-6907-40f0-a0b2-ac0e8c87a954" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Lock "cinder-quobyte-eab254b0-6907-40f0-a0b2-ac0e8c87a954" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d230a747-e31b-44c1-874c-117f3b2305b3]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[85661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 Apr 15 10:11:24 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_s9amp5_j" returned: 1 in 0.624s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_s9amp5_j' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d1afb-61ec-4ae2-b8e1-381e7816190c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD Apr 15 10:11:24 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954" returned: 0 in 0.532s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:24 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954 Apr 15 10:11:24 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:25 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Flow 'volume_create_manager' (492ae954-3b8c-4ae2-9c48-55655a3e2f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d63ca4-7c82-4026-82d3-679bdab8f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] 019e5b32-dfb6-4970-afa1-ec198cc6628d was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d63ca4-7c82-4026-82d3-679bdab8f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1411667921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9011d704-e273-420b-b2cd-a399617c8ace,host='devstack@QuobyteHD#QuobyteHD',id=8a581a6e-85a1-428b-8442-66761344d0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076f36f7ab2742d888b8a2fb6fc4a9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:25Z,use_quota=True,user_id='f00b18887f4445a9ae200c89cbbf3265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85847309-2793-46be-8910-17389b45bc81),volume_type_id=85847309-2793-46be-8910-17389b45bc81)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:25 devstack sudo[85675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 Apr 15 10:11:25 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c710c8-39e5-447c-a7e7-dd65f43ef068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c710c8-39e5-447c-a7e7-dd65f43ef068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89b61b2-c7b7-4b4a-b824-2a0613779a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89b61b2-c7b7-4b4a-b824-2a0613779a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a581a6e-85a1-428b-8442-66761344d0c1', 'volume_name': 'volume-8a581a6e-85a1-428b-8442-66761344d0c1', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4689fd-7000-4515-8c21-fef455cbe306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4689fd-7000-4515-8c21-fef455cbe306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867d0718-b5e8-4640-88b1-c81d5daf63b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Volume 8a581a6e-85a1-428b-8442-66761344d0c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a581a6e-85a1-428b-8442-66761344d0c1', 'volume_size': 1} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9011d704-e273-420b-b2cd-a399617c8ace,created_at=2026-04-15T08:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1411667921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9011d704-e273-420b-b2cd-a399617c8ace,host='devstack@QuobyteHD#QuobyteHD',id=8a581a6e-85a1-428b-8442-66761344d0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076f36f7ab2742d888b8a2fb6fc4a9a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:25Z,use_quota=True,user_id='f00b18887f4445a9ae200c89cbbf3265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85847309-2793-46be-8910-17389b45bc81),volume_type_id=85847309-2793-46be-8910-17389b45bc81)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Creating volume 8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:25 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 1073741824 Apr 15 10:11:25 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:25 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-eab254b0-6907-40f0-a0b2-ac0e8c87a954" returned: 0 in 0.776s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Lock "cinder-quobyte-eab254b0-6907-40f0-a0b2-ac0e8c87a954" released by "delete_volume" :: held 1.355s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Created reservations ['dae384df-2f0f-4620-9fed-d2097841ef48', 'a3d6e429-b072-406c-a2b1-08431af60291', 'ba76a7bb-e8dd-4d33-a73a-a38826c9d9a4', '7760d1dc-9f5e-49bf-bb6c-8c1b43ec8eb9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:25 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 1073741824" returned: 0 in 0.718s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 Apr 15 10:11:26 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.604s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Deleted volume successfully. Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ed44f4bc-36e2-4f16-8572-a9231a9c40c2 tempest-VolumesActionsTest-1729292014 None] Lock "cinder-eab254b0-6907-40f0-a0b2-ac0e8c87a954-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:26 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341" returned: 0 in 1.326s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_xoccljcndevstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:26 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Converted 112.00 MB image at 84.44 MB/s Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 1G Apr 15 10:11:26 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1" returned: 0 in 0.804s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867d0718-b5e8-4640-88b1-c81d5daf63b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a581a6e-85a1-428b-8442-66761344d0c1', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b297eb4e-5a88-4f85-9628-e61a913e0d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:26 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Volume volume-8a581a6e-85a1-428b-8442-66761344d0c1 (8a581a6e-85a1-428b-8442-66761344d0c1): created successfully Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b297eb4e-5a88-4f85-9628-e61a913e0d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Flow 'volume_create_manager' (492ae954-3b8c-4ae2-9c48-55655a3e2f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-31544d96-859b-4ba1-91a2-279c1633dd43 tempest-GroupsV314Test-1683524499 None] Created volume successfully. Apr 15 10:11:27 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 1G" returned: 0 in 0.585s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6cefdc-a1be-4458-9fbf-b32d9e456fc0]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 Apr 15 10:11:27 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:27 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341" returned: 0 in 0.615s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 Apr 15 10:11:27 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:28 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Cloning volume 8a581a6e-85a1-428b-8442-66761344d0c1 to volume 62d61e16-7962-4c82-95ff-4a449b43acfc Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Creating offline snapshot 7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d of volume 8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b172be-430b-4923-a1ae-85e8e05d064e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:28 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341" returned: 1 in 0.684s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Downloaded image 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 98d4306e-5226-45e7-8f23-e67290dea341 successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d for user 1b91913419ff4a6a8ccb1650e46232b4 is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Marking volume 98d4306e-5226-45e7-8f23-e67290dea341 as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Copying metadata from image 019e5b32-dfb6-4970-afa1-ec198cc6628d to 98d4306e-5226-45e7-8f23-e67290dea341. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Creating volume glance metadata for volume 98d4306e-5226-45e7-8f23-e67290dea341 backed by image 019e5b32-dfb6-4970-afa1-ec198cc6628d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:11:28 devstack sudo[85808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 Apr 15 10:11:28 devstack sudo[85808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d3b03b-9b8b-44ec-b072-65ac815be9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d4306e-5226-45e7-8f23-e67290dea341', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf821c15-9a66-45cc-8058-e7ca35d8788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:28 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Volume volume-98d4306e-5226-45e7-8f23-e67290dea341 (98d4306e-5226-45e7-8f23-e67290dea341): created successfully Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf821c15-9a66-45cc-8058-e7ca35d8788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Flow 'volume_create_manager' (eb2ba623-ab88-4062-9ddd-4012cb94af7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-73ac8cd5-6fc7-4f95-87e3-e293ac0d550a tempest-VolumesImageMetadata-604445054 None] Created volume successfully. Apr 15 10:11:29 devstack sudo[85808]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1" returned: 0 in 0.638s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:29 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d 1G Apr 15 10:11:29 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Acquiring lock "cinder-98d4306e-5226-45e7-8f23-e67290dea341-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Lock "cinder-98d4306e-5226-45e7-8f23-e67290dea341-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Acquiring lock "cinder-quobyte-98d4306e-5226-45e7-8f23-e67290dea341" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Lock "cinder-quobyte-98d4306e-5226-45e7-8f23-e67290dea341" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4773b0-2dda-4184-9e0c-fdb00bcd267c]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:29 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 Apr 15 10:11:29 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:29 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d 1G" returned: 0 in 0.693s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a581a6e-85a1-428b-8442-66761344d0c1 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:29 devstack sudo[85833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a581a6e-85a1-428b-8442-66761344d0c1 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d Apr 15 10:11:29 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341" returned: 0 in 0.559s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 Apr 15 10:11:30 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a581a6e-85a1-428b-8442-66761344d0c1 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" returned: 0 in 0.521s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d Apr 15 10:11:30 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341" returned: 1 in 0.697s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341 Apr 15 10:11:30 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" returned: 0 in 0.759s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.info Apr 15 10:11:31 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-98d4306e-5226-45e7-8f23-e67290dea341" returned: 0 in 0.598s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Lock "cinder-quobyte-98d4306e-5226-45e7-8f23-e67290dea341" released by "delete_volume" :: held 1.908s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Created reservations ['dcc6a5b1-3cb1-438f-9f4e-d20c06c23467', 'fcd407cb-5587-4990-aeb2-b3dfc8a52252', 'd69856b4-9a01-41d1-8bb1-8e5823c014b0', 'aff7a6b7-2c7b-4558-8d35-dd70f599ad82'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.info" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:31 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.info Apr 15 10:11:31 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:32 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.502s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Deleted volume successfully. Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b868e44e-9247-45f0-8ebb-a3f4a1d85cf1 tempest-VolumesImageMetadata-604445054 None] Lock "cinder-98d4306e-5226-45e7-8f23-e67290dea341-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:32 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.info" returned: 0 in 0.858s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Acquiring lock "cinder-quobyte-62d61e16-7962-4c82-95ff-4a449b43acfc" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-62d61e16-7962-4c82-95ff-4a449b43acfc" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] snapshot: 7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d, volume: 62d61e16-7962-4c82-95ff-4a449b43acfc, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d856ce3-c79a-4dc5-a7eb-14f4bd5b5f6f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:32 devstack sudo[85863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d Apr 15 10:11:32 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:33 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" returned: 0 in 0.831s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a581a6e-85a1-428b-8442-66761344d0c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50704459-1385-4b9d-abf1-15684db98450]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:33 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:33 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 Apr 15 10:11:33 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (8d072c7b-4195-466d-83a4-f6ea9c74a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc6af40-52dc-4f24-a0b6-bb32737daf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc6af40-52dc-4f24-a0b6-bb32737daf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111126823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93569cf-7ee5-419a-8b4b-3bc7cb8bef62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:33Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2eef45-1f7e-463c-bdba-855ebfa968e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2eef45-1f7e-463c-bdba-855ebfa968e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7536a86-4216-4e4b-8aab-7723b6e4bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7536a86-4216-4e4b-8aab-7723b6e4bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93569cf-7ee5-419a-8b4b-3bc7cb8bef62', 'volume_name': 'volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b25760f-4ac9-496a-9b80-edf9d99848f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b25760f-4ac9-496a-9b80-edf9d99848f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43aa16a-c190-46a5-94e5-ee617b3dc213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:33 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Volume f93569cf-7ee5-419a-8b4b-3bc7cb8bef62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62', 'volume_size': 1} Apr 15 10:11:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:34 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.767s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:34 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1" returned: 0 in 0.742s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:11:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc Apr 15 10:11:34 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:38 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc" returned: 0 in 4.014s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9a941-a299-46a3-8ac5-7b671d009146]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:38 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 Apr 15 10:11:38 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:39 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1" returned: 0 in 0.955s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1, size 1024.00 MB, duration 4.02 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:39 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Converted 1024.00 MB image at 255.01 MB/s Apr 15 10:11:39 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:39 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc Apr 15 10:11:39 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Flow 'volume_create_manager' (91c92bd4-0415-49fb-b4d1-a7a67011e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6f68f6-407d-4e0a-9010-a62c83f0e436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c6f68f6-407d-4e0a-9010-a62c83f0e436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-758005878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe3ab72f0a64accaed021d3d3bd35a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:40Z,use_quota=True,user_id='3dc107e34b994c2ea5d7b6246c6930a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dad1dd9-7d80-476a-9c6d-a4c63c0055e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dad1dd9-7d80-476a-9c6d-a4c63c0055e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf55d7f-d259-46ac-bb31-953db8bc0ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf55d7f-d259-46ac-bb31-953db8bc0ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e92d9c-99fe-4ffb-83e9-b0af9e5234f6', 'volume_name': 'volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c76c847-4194-4f2f-98e4-637b5aafa879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c76c847-4194-4f2f-98e4-637b5aafa879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf06e81-8ead-4af8-adc4-39b312671b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Volume d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6', 'volume_size': 1} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:39 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc" returned: 0 in 0.722s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-62d61e16-7962-4c82-95ff-4a449b43acfc" released by "_copy_volume_from_snapshot" :: held 7.361s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Acquiring lock "cinder-quobyte-7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Deleting offline snapshot 7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d of volume 8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] snapshot_file for this snap is: volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fac8b07-3716-43bc-8abc-65e25ba68956]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:39 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d Apr 15 10:11:39 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:40 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" returned: 0 in 0.677s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a581a6e-85a1-428b-8442-66761344d0c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde4ccf-ff6f-4ad4-a8d5-25a037c4b64d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:40 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 Apr 15 10:11:40 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:41 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1" returned: 0 in 0.663s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:41 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d Apr 15 10:11:41 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:41 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" returned: 0 in 0.703s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:41 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d Apr 15 10:11:41 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:42 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1.7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" returned: 0 in 0.578s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-7b3a5d88-d67d-4fc7-8c03-7a2c763cfa0d" released by "_delete_snapshot" :: held 2.709s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.261s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.845s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111126823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93569cf-7ee5-419a-8b4b-3bc7cb8bef62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:33Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Creating volume f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:42 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:42 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 1073741824 Apr 15 10:11:42 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fe690f85-e7ab-45b8-b5b8-0ebb9bfc9ed6 tempest-GroupsV314Test-1683524499 None] Create group from source-group-9011d704-e273-420b-b2cd-a399617c8ace completed successfully. Apr 15 10:11:43 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 1073741824" returned: 0 in 0.643s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 Apr 15 10:11:43 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Acquiring lock "cinder-quobyte-62d61e16-7962-4c82-95ff-4a449b43acfc" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-62d61e16-7962-4c82-95ff-4a449b43acfc" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7220125-74ab-46f6-a5f0-d2e7aec67d1e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62" returned: 0 in 0.552s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.042s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-758005878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe3ab72f0a64accaed021d3d3bd35a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:40Z,use_quota=True,user_id='3dc107e34b994c2ea5d7b6246c6930a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Creating volume d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:43 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43aa16a-c190-46a5-94e5-ee617b3dc213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc Apr 15 10:11:43 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 1073741824 Apr 15 10:11:43 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c294e601-0433-4bc3-924e-e87efff578f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Volume volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 (f93569cf-7ee5-419a-8b4b-3bc7cb8bef62): created successfully Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c294e601-0433-4bc3-924e-e87efff578f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (8d072c7b-4195-466d-83a4-f6ea9c74a69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-84e85a23-81af-459f-998d-dc38c85b9733 tempest-VolumesActionsTest-1729292014 None] Created volume successfully. Apr 15 10:11:44 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc" returned: 0 in 0.610s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc Apr 15 10:11:44 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 1073741824" returned: 0 in 0.662s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Lock "cinder-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-quobyte-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:44 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 Apr 15 10:11:44 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e709343a-47d2-439a-872f-8105b2cfe33b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 Apr 15 10:11:44 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62d61e16-7962-4c82-95ff-4a449b43acfc" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-62d61e16-7962-4c82-95ff-4a449b43acfc" released by "delete_volume" :: held 1.114s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:44 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Created reservations ['c709be2f-4f3f-40ad-a377-156537bd3703'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:45 devstack cinder-volume[82850]: WARNING cinder.quota [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1567705529 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1567705529, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:45 devstack cinder-volume[82850]: WARNING cinder.quota [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1567705529 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1567705529, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Created reservations ['d71f3a93-361a-4750-b7f8-7cdbff0feda4', 'f6610abb-3797-429d-ac50-246cfc11024e', '96c0c4cb-768e-469d-861b-0753ca0c197e', 'a1855715-5c4a-4313-a230-0fb95cacb776'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:45 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:45 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:45 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6" returned: 0 in 0.705s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf06e81-8ead-4af8-adc4-39b312671b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5092bda-9a12-4094-bbb2-1aa901cb3b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Volume volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 (d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6): created successfully Apr 15 10:11:45 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5092bda-9a12-4094-bbb2-1aa901cb3b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Flow 'volume_create_manager' (91c92bd4-0415-49fb-b4d1-a7a67011e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62" returned: 0 in 0.668s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d48afbba-cc6e-453d-b84d-c841a2bd173e tempest-VolumesTransfersTest-1238237121 None] Created volume successfully. Apr 15 10:11:45 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62 Apr 15 10:11:45 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:45 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.582s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:45 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4366aed6-f2c6-4bbd-80c3-bac8ec07fb7c tempest-GroupsV314Test-1683524499 None] Delete group completed successfully. Apr 15 10:11:46 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62" returned: 0 in 0.639s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62" released by "delete_volume" :: held 1.348s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Created reservations ['bc82a7ed-d8c1-4aa9-a3f2-d902c568e531', '03a437a7-803e-49a9-ab50-9db0af6b105c', '8f7b81ba-57aa-42f1-a9f7-0bb4d4831504', '1d526b7c-6012-4bdb-9caf-c78715f8e84b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:46 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Acquiring lock "cinder-quobyte-8a581a6e-85a1-428b-8442-66761344d0c1" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-8a581a6e-85a1-428b-8442-66761344d0c1" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa6b8f7-8c49-45f5-91f1-fe8a49fd3ca1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 Apr 15 10:11:46 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.951s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Deleted volume successfully. Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b8b331b8-c968-4066-b9ab-8822ce3faa3e tempest-VolumesActionsTest-806879594 None] Lock "cinder-f93569cf-7ee5-419a-8b4b-3bc7cb8bef62-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-92132cc6-9ef0-4262-8d54-7dfbdfa34f9e tempest-VolumesTransfersTest-934269003 None] Transfer volume completed successfully. Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (45b45c3d-4455-4728-9827-41665241a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da617fcb-226d-4dcf-8124-a97b7594c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da617fcb-226d-4dcf-8124-a97b7594c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1482649079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064f5a1b-01ca-4030-a418-83f4979ea12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:47Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d58908-d401-437f-a0c2-9bcf53e3c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d58908-d401-437f-a0c2-9bcf53e3c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf7a80a-934b-4a93-aef9-3bc89ef72714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf7a80a-934b-4a93-aef9-3bc89ef72714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064f5a1b-01ca-4030-a418-83f4979ea12d', 'volume_name': 'volume-064f5a1b-01ca-4030-a418-83f4979ea12d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176cb95b-bf31-454b-93e9-a2cbc485d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176cb95b-bf31-454b-93e9-a2cbc485d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bb574f-73b3-4dd8-8bbf-a5377cd787ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:47 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Volume 064f5a1b-01ca-4030-a418-83f4979ea12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064f5a1b-01ca-4030-a418-83f4979ea12d', 'volume_size': 1} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1482649079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064f5a1b-01ca-4030-a418-83f4979ea12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:47Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Creating volume 064f5a1b-01ca-4030-a418-83f4979ea12d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:47 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:47 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d 1073741824 Apr 15 10:11:47 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1" returned: 0 in 1.363s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:47 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1 Apr 15 10:11:47 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Acquiring lock "cinder-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Lock "cinder-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Acquiring lock "cinder-quobyte-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Lock "cinder-quobyte-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6" acquired by "delete_volume" :: waited 0.037s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d1f9f-105a-4606-9729-f44822f8aa5f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:48 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8a581a6e-85a1-428b-8442-66761344d0c1" returned: 0 in 1.123s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:48 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 Apr 15 10:11:48 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Flow 'volume_create_manager' (d2a8348f-624b-42dd-ad99-4e821844e1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0387ad-f42a-4e3b-9432-106c61fc1644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:48 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Lock "cinder-quobyte-8a581a6e-85a1-428b-8442-66761344d0c1" released by "delete_volume" :: held 2.605s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0387ad-f42a-4e3b-9432-106c61fc1644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:48Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749981fb-1a7f-43e3-a3f5-fdd2a33a598a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165de80652f645279321ba2d552f7b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:49Z,use_quota=True,user_id='22772adf7b074ffab8a504ea5f100813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19b195-3bc8-4dda-8f09-9bc072589a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c19b195-3bc8-4dda-8f09-9bc072589a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dde517-eda1-414a-a169-df82e09bd76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG cinder.image.glance [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Creating Keystone auth plugin from conf {{(pid=82850) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:11:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d 1073741824" returned: 0 in 1.318s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Created reservations ['f00d4452-fc2d-4e1f-afde-1261a90b3580'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:49 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d Apr 15 10:11:49 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Created reservations ['d417e5a5-fac5-4c85-a50a-b052fd148326', '94c60d1f-c5d5-4a65-be09-04e43f51a834', '0b441263-1008-4a62-9661-93963ed3cac8', '365573e9-19fa-46d0-b387-70aa66333bea'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1dde517-eda1-414a-a169-df82e09bd76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '749981fb-1a7f-43e3-a3f5-fdd2a33a598a', 'volume_name': 'volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d813662-19ea-4aac-93c3-612029633315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d813662-19ea-4aac-93c3-612029633315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45999a45-a262-4d6e-b941-5ebb91468901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Volume 749981fb-1a7f-43e3-a3f5-fdd2a33a598a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Trying to clone 749981fb-1a7f-43e3-a3f5-fdd2a33a598a from image 019e5b32-dfb6-4970-afa1-ec198cc6628d at location (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:49 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:49 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:11:49 devstack cinder-volume[82850]: INFO cinder.image.image_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a03c57-c531-4392-8c57-b7f0b3bce265]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:49 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD Apr 15 10:11:49 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:49 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d" returned: 0 in 0.922s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bb574f-73b3-4dd8-8bbf-a5377cd787ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064f5a1b-01ca-4030-a418-83f4979ea12d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227b0197-9423-4311-905e-da416b504d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Volume volume-064f5a1b-01ca-4030-a418-83f4979ea12d (064f5a1b-01ca-4030-a418-83f4979ea12d): created successfully Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227b0197-9423-4311-905e-da416b504d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (45b45c3d-4455-4728-9827-41665241a710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-83ed8b3b-cf07-4045-9999-91369ed846b1 tempest-VolumesActionsTest-1729292014 None] Created volume successfully. Apr 15 10:11:50 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6" returned: 0 in 1.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6 Apr 15 10:11:50 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:50 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.040s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-117e65b7-3ba1-490c-a091-ff95ac4b7adc tempest-GroupsV314Test-1683524499 None] Delete group completed successfully. Apr 15 10:11:50 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6" returned: 0 in 0.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Lock "cinder-quobyte-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6" released by "delete_volume" :: held 2.068s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:50 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d is fetched for user 22772adf7b074ffab8a504ea5f100813. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Created reservations ['6619264d-64af-4379-9bd0-5c793ca5bf27', '5f37ed2e-030b-492b-be5a-01f8d37f37b5', '346ca807-1f69-4084-8414-c66d1a6a1292', '0c5fb8e1-4d20-482c-82d3-f1d31e1acbc7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24d28d3-48f0-4d20-b677-cce30bc6ad7a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:50 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:50 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD Apr 15 10:11:50 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-064f5a1b-01ca-4030-a418-83f4979ea12d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Lock "cinder-064f5a1b-01ca-4030-a418-83f4979ea12d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:51 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-quobyte-064f5a1b-01ca-4030-a418-83f4979ea12d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:48Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=749981fb-1a7f-43e3-a3f5-fdd2a33a598a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='165de80652f645279321ba2d552f7b2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:49Z,use_quota=True,user_id='22772adf7b074ffab8a504ea5f100813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Creating volume 749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-064f5a1b-01ca-4030-a418-83f4979ea12d" acquired by "delete_volume" :: waited 0.042s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e3da9b-7d95-4bb8-839e-5d14686f17fd]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:51 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a 1073741824 Apr 15 10:11:51 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:51 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.986s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Deleted volume successfully. Apr 15 10:11:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1963c3cd-7c22-4920-8a33-911905512cf9 tempest-VolumesTransfersTest-231107912 None] Lock "cinder-d9e92d9c-99fe-4ffb-83e9-b0af9e5234f6-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:51 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d Apr 15 10:11:51 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=131,cinder:UPDATE=129,cinder:DELETE=7,cinder:INSERT=23 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=138,cinder:UPDATE=156,cinder:INSERT=51,cinder:DELETE=8 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Flow 'volume_create_manager' (b07dfdf4-fc8f-42e7-a4b0-18a7bbeeb7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63da1464-78fc-4870-9eb2-c046feab31d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63da1464-78fc-4870-9eb2-c046feab31d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1294131008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ea9d6c-fcde-4ed9-9c85-a03399cc1536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe3ab72f0a64accaed021d3d3bd35a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:52Z,use_quota=True,user_id='3dc107e34b994c2ea5d7b6246c6930a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06540322-8f76-45d3-80a4-8896ad4dfeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:52 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06540322-8f76-45d3-80a4-8896ad4dfeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368d99e9-46c2-46d4-bfe8-883964ce463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368d99e9-46c2-46d4-bfe8-883964ce463b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ea9d6c-fcde-4ed9-9c85-a03399cc1536', 'volume_name': 'volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e4fdfc-ea16-47ee-93da-977b379a9f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e4fdfc-ea16-47ee-93da-977b379a9f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfea7748-2b25-4c64-9e3c-b5201a26160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Volume 63ea9d6c-fcde-4ed9-9c85-a03399cc1536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536', 'volume_size': 1} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a 1073741824" returned: 0 in 0.927s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:52 devstack sudo[86075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:11:52 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:52 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d" returned: 0 in 1.108s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:52 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d Apr 15 10:11:52 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:53 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 0 in 0.556s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.591s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1294131008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ea9d6c-fcde-4ed9-9c85-a03399cc1536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe3ab72f0a64accaed021d3d3bd35a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:52Z,use_quota=True,user_id='3dc107e34b994c2ea5d7b6246c6930a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Creating volume 63ea9d6c-fcde-4ed9-9c85-a03399cc1536 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:53 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:53 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 1073741824 Apr 15 10:11:53 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Attempting download of 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 749981fb-1a7f-43e3-a3f5-fdd2a33a598a. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[92964fd0-4aa4-480e-8c05-459510f32139]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_fz5jcjkb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:53 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-064f5a1b-01ca-4030-a418-83f4979ea12d" returned: 0 in 0.575s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-064f5a1b-01ca-4030-a418-83f4979ea12d" released by "delete_volume" :: held 1.722s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:53 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_fz5jcjkb Apr 15 10:11:53 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Created reservations ['fe7ea0ed-afa9-4922-bab7-100d902439dc', '078bdf4f-3349-4739-8d4d-b8974e4cefe8', '18a13bc4-61d0-472c-b89b-01c60afda7fe', 'be930047-a0a6-4314-8fcd-95081a94b7a8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:53 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:53 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:53 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 1073741824" returned: 0 in 0.819s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:53 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 Apr 15 10:11:53 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:54 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_fz5jcjkb" returned: 0 in 1.015s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_fz5jcjkb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:54 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_fz5jcjkb Apr 15 10:11:54 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (e0e51998-5028-4f03-9301-3482d5bfeb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a0f88e-958d-423f-aa8b-b0b38e932c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:54 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a0f88e-958d-423f-aa8b-b0b38e932c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449164877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782058a5-c86a-4a94-8f31-5c17f05875fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:54Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfef3c27-0f08-4a09-845a-50f0679a8086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfef3c27-0f08-4a09-845a-50f0679a8086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e27a11-59f7-4c6c-9b7e-725f59c10389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e27a11-59f7-4c6c-9b7e-725f59c10389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782058a5-c86a-4a94-8f31-5c17f05875fa', 'volume_name': 'volume-782058a5-c86a-4a94-8f31-5c17f05875fa', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f6ac4e-f1e0-4687-ab2f-40093b8447b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f6ac4e-f1e0-4687-ab2f-40093b8447b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb348a10-d150-4905-b259-13cd2946bd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:54 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Volume 782058a5-c86a-4a94-8f31-5c17f05875fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782058a5-c86a-4a94-8f31-5c17f05875fa', 'volume_size': 1} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.918s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Deleted volume successfully. Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6add32a9-df83-4529-a6cd-ec14a3ad92d9 tempest-VolumesActionsTest-806879594 None] Lock "cinder-064f5a1b-01ca-4030-a418-83f4979ea12d-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:54 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536" returned: 0 in 0.790s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-449164877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782058a5-c86a-4a94-8f31-5c17f05875fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:54Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Creating volume 782058a5-c86a-4a94-8f31-5c17f05875fa {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:54 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfea7748-2b25-4c64-9e3c-b5201a26160d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ab0d50-483e-43be-b821-45729a9f7d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:54 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa 1073741824 Apr 15 10:11:54 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:54 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Volume volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 (63ea9d6c-fcde-4ed9-9c85-a03399cc1536): created successfully Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ab0d50-483e-43be-b821-45729a9f7d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Flow 'volume_create_manager' (b07dfdf4-fc8f-42e7-a4b0-18a7bbeeb7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2b92e232-9894-4bc4-b362-e0fddf06db58 tempest-VolumesTransfersTest-1238237121 None] Created volume successfully. Apr 15 10:11:54 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_fz5jcjkb" returned: 1 in 0.752s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_fz5jcjkb' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45251ff-9586-449f-815a-b2b3caae3cce]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:55 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD Apr 15 10:11:55 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:55 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa 1073741824" returned: 0 in 0.826s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:55 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa Apr 15 10:11:55 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:55 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] 019e5b32-dfb6-4970-afa1-ec198cc6628d was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:55 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:11:55 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Flow 'volume_create_manager' (c79b9d84-f38b-4fc7-ae2b-cd3bc751ba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc84f705-1951-4da5-969c-6dc5aa16aa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc84f705-1951-4da5-969c-6dc5aa16aa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-974124717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f374cf-0216-4967-a336-2cbf7b1f4c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b9734fe3d84cca95e70bce0c334615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:56Z,use_quota=True,user_id='c6c5b7eec6c94af7a42e5aea0a99d71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea7533-3d0e-42cf-9b0f-10c9c9ce13e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ea7533-3d0e-42cf-9b0f-10c9c9ce13e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6359590d-9c7f-4604-9a19-e8079bc2eb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6359590d-9c7f-4604-9a19-e8079bc2eb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f374cf-0216-4967-a336-2cbf7b1f4c5a', 'volume_name': 'volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80e86eb-e0d5-4e37-a7c3-1eee6bed6e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80e86eb-e0d5-4e37-a7c3-1eee6bed6e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323fd66d-7a0a-4d32-a269-000953f41adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a', 'volume_size': 1} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Acquiring lock "cinder-63ea9d6c-fcde-4ed9-9c85-a03399cc1536-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Lock "cinder-63ea9d6c-fcde-4ed9-9c85-a03399cc1536-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:56 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Acquiring lock "cinder-quobyte-63ea9d6c-fcde-4ed9-9c85-a03399cc1536" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa" returned: 0 in 0.535s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-974124717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f374cf-0216-4967-a336-2cbf7b1f4c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04b9734fe3d84cca95e70bce0c334615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:56Z,use_quota=True,user_id='c6c5b7eec6c94af7a42e5aea0a99d71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Creating volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:56 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Lock "cinder-quobyte-63ea9d6c-fcde-4ed9-9c85-a03399cc1536" acquired by "delete_volume" :: waited 0.044s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:56 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a 1073741824 Apr 15 10:11:56 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb348a10-d150-4905-b259-13cd2946bd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782058a5-c86a-4a94-8f31-5c17f05875fa', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28f32cd-ad1a-44a2-b642-8463469692e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b18acef-c370-4b40-9257-380fbc3f6f2f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Volume volume-782058a5-c86a-4a94-8f31-5c17f05875fa (782058a5-c86a-4a94-8f31-5c17f05875fa): created successfully Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28f32cd-ad1a-44a2-b642-8463469692e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (e0e51998-5028-4f03-9301-3482d5bfeb3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-90c1bf70-608d-4023-842b-7ce2297e23ff tempest-VolumesActionsTest-1729292014 None] Created volume successfully. Apr 15 10:11:56 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 Apr 15 10:11:56 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-782058a5-c86a-4a94-8f31-5c17f05875fa-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Lock "cinder-782058a5-c86a-4a94-8f31-5c17f05875fa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-quobyte-782058a5-c86a-4a94-8f31-5c17f05875fa" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-782058a5-c86a-4a94-8f31-5c17f05875fa" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c963f5-8313-42e1-a5a6-5f05b3ac48f2]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:56 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa Apr 15 10:11:56 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:57 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a 1073741824" returned: 0 in 0.966s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 0 in 1.471s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_1kzg2abudevstack@QuobyteHD, size 112.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:57 devstack cinder-volume[82850]: INFO cinder.image.image_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Converted 112.00 MB image at 76.07 MB/s Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536" returned: 0 in 0.931s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a 1G Apr 15 10:11:57 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536 Apr 15 10:11:57 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:57 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a Apr 15 10:11:57 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:57 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa" returned: 0 in 0.843s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a 1G" returned: 0 in 0.594s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d52901-1ceb-467f-810c-a576f239ebfb]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa Apr 15 10:11:57 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:57 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:11:57 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:57 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" returned: 0 in 0.756s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (323fd66d-7a0a-4d32-a269-000953f41adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a0d5cf-73c6-498d-a5ef-0fc247aa21ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Volume volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a (b7f374cf-0216-4967-a336-2cbf7b1f4c5a): created successfully Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a0d5cf-73c6-498d-a5ef-0fc247aa21ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Flow 'volume_create_manager' (c79b9d84-f38b-4fc7-ae2b-cd3bc751ba5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f4233e60-0549-4386-b5e5-5652b8897772 tempest-SnapshotsActionsTest-1465220904 None] Created volume successfully. Apr 15 10:11:58 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-63ea9d6c-fcde-4ed9-9c85-a03399cc1536" returned: 0 in 0.919s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Lock "cinder-quobyte-63ea9d6c-fcde-4ed9-9c85-a03399cc1536" released by "delete_volume" :: held 1.910s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Created reservations ['89a7786e-dd44-4109-9465-85e3a6dbc389', '702aed59-fd63-462c-90a2-cf40a1c52e63', '4dfa1ddf-6199-43e8-a6ee-a9c308d44043', '53d4a097-c0cc-43a6-9545-42c0f3cff822'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:58 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-782058a5-c86a-4a94-8f31-5c17f05875fa" returned: 0 in 0.653s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-782058a5-c86a-4a94-8f31-5c17f05875fa" released by "delete_volume" :: held 1.524s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Created reservations ['bf836ffd-a154-4bba-a533-6a3b85bd2027', 'ad528198-1de8-4edd-81f4-9c1f64b57403', 'fccb751f-5dd3-48ba-bc8c-7d1125c89871', 'edd06f55-dc4b-42ec-8143-00e22beadcf6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:58 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 0 in 0.746s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:11:58 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:11:58 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.642s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Deleted volume successfully. Apr 15 10:11:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4365dd4-12e7-424e-b414-75b2502a267f tempest-VolumesTransfersTest-231107912 None] Lock "cinder-63ea9d6c-fcde-4ed9-9c85-a03399cc1536-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Creating offline snapshot 6ae7c4b4-34c7-448a-8e26-f7a6397e0249 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45b5ba7-f4ae-4747-9066-55b6a2253da9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:59 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.853s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Deleted volume successfully. Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b683f7b3-21f9-48b5-87fc-88afdf022f5b tempest-VolumesActionsTest-806879594 None] Lock "cinder-782058a5-c86a-4a94-8f31-5c17f05875fa-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:59 devstack sudo[86198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a Apr 15 10:11:59 devstack sudo[86198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:59 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 1 in 1.137s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Downloaded image 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 749981fb-1a7f-43e3-a3f5-fdd2a33a598a successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d for user 22772adf7b074ffab8a504ea5f100813 is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Marking volume 749981fb-1a7f-43e3-a3f5-fdd2a33a598a as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Copying metadata from image 019e5b32-dfb6-4970-afa1-ec198cc6628d to 749981fb-1a7f-43e3-a3f5-fdd2a33a598a. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Creating volume glance metadata for volume 749981fb-1a7f-43e3-a3f5-fdd2a33a598a backed by image 019e5b32-dfb6-4970-afa1-ec198cc6628d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (1fe6f0a6-1987-4463-af5c-7aa7e72b5a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1d2bb5-6097-44f6-a454-d47542a8d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1d2bb5-6097-44f6-a454-d47542a8d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1908903881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ee801d-badb-4ece-90a8-2ef588a18727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:00Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f35d59-440b-4295-8a39-2c75a60da3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f35d59-440b-4295-8a39-2c75a60da3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b1d9b-1404-4279-b61f-516d73e3c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b1d9b-1404-4279-b61f-516d73e3c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ee801d-badb-4ece-90a8-2ef588a18727', 'volume_name': 'volume-57ee801d-badb-4ece-90a8-2ef588a18727', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381aa175-49d7-4327-b334-1a99760f2997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381aa175-49d7-4327-b334-1a99760f2997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62cc59f-d68f-4aac-b72a-7b9578bc13ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Volume 57ee801d-badb-4ece-90a8-2ef588a18727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ee801d-badb-4ece-90a8-2ef588a18727', 'volume_size': 1} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45999a45-a262-4d6e-b941-5ebb91468901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c17b7b-c07e-41b6-9c7d-7161f6ace4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Volume volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a (749981fb-1a7f-43e3-a3f5-fdd2a33a598a): created successfully Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c17b7b-c07e-41b6-9c7d-7161f6ace4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Flow 'volume_create_manager' (d2a8348f-624b-42dd-ad99-4e821844e1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-0d45a268-cd8b-439b-ae98-96c30b25e0c6 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Created volume successfully. Apr 15 10:12:00 devstack sudo[86198]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" returned: 0 in 0.890s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:00 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 1G Apr 15 10:12:00 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:00 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 1G" returned: 0 in 0.722s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:01 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.537s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:01 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 is being set with open permissions: ugo+rw Apr 15 10:12:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:01 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:02 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.591s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:02 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.info Apr 15 10:12:02 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:02 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.info" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.info is being set with open permissions: ugo+rw Apr 15 10:12:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:02 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.info Apr 15 10:12:02 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:03 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.info" returned: 0 in 0.477s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.777s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.314s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1908903881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ee801d-badb-4ece-90a8-2ef588a18727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:00Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Creating volume 57ee801d-badb-4ece-90a8-2ef588a18727 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:03 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:03 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 1073741824 Apr 15 10:12:03 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1b3d6619-fa33-4d9d-946b-248b23439ceb tempest-SnapshotsActionsTest-1465220904 None] Create snapshot completed successfully Apr 15 10:12:04 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 1073741824" returned: 0 in 0.866s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:04 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 Apr 15 10:12:04 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:04 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.964s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62cc59f-d68f-4aac-b72a-7b9578bc13ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ee801d-badb-4ece-90a8-2ef588a18727', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae55319-fdd3-46b6-93df-2659ad8e1b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Volume volume-57ee801d-badb-4ece-90a8-2ef588a18727 (57ee801d-badb-4ece-90a8-2ef588a18727): created successfully Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae55319-fdd3-46b6-93df-2659ad8e1b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (1fe6f0a6-1987-4463-af5c-7aa7e72b5a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a833bd-d726-4973-857a-13e2ae18d2fa]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-402766d8-5325-40ea-bcdb-c7ee86b26135 tempest-VolumesActionsTest-1729292014 None] Created volume successfully. Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Flow 'volume_create_manager' (aab1fb5f-19dc-4ab1-a7a4-177b4db88ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6860c1e-ff27-45f8-8639-7d711301ea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6860c1e-ff27-45f8-8639-7d711301ea04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1645952927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab1b477-ac87-4847-8ede-14781f5fe84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e792c7bfde84597a687a08bbd6f6aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:05Z,use_quota=True,user_id='c434e1da607d442a907a80a2559809be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:12:04 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceba231-b5ad-472e-90a0-61a64ed59242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aceba231-b5ad-472e-90a0-61a64ed59242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f285d8e-1ec4-49aa-9d99-cf7dca2b2003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f285d8e-1ec4-49aa-9d99-cf7dca2b2003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ab1b477-ac87-4847-8ede-14781f5fe84d', 'volume_name': 'volume-9ab1b477-ac87-4847-8ede-14781f5fe84d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ada3921-9733-4b05-861b-62b993176b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ada3921-9733-4b05-861b-62b993176b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44844cf9-d116-4e5c-abe4-99944687e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Volume 9ab1b477-ac87-4847-8ede-14781f5fe84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ab1b477-ac87-4847-8ede-14781f5fe84d', 'volume_size': 1} Apr 15 10:12:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:05 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:12:05 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-57ee801d-badb-4ece-90a8-2ef588a18727-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Lock "cinder-57ee801d-badb-4ece-90a8-2ef588a18727-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Acquiring lock "cinder-quobyte-57ee801d-badb-4ece-90a8-2ef588a18727" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-57ee801d-badb-4ece-90a8-2ef588a18727" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee32df7-d476-4faa-9f30-210678e1fa00]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[86248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 Apr 15 10:12:05 devstack sudo[86248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 1 in 0.538s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.087s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.462s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Creating offline snapshot 17af766f-6848-4561-a95b-73d95021aa75 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00645fe-3899-4009-b91a-16013834ad22]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383', 'name': 'volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef450e8c-4683-4fc6-a210-a9b9403fdb3f', 'enforce_multipath': True} {{(pid=82850) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:12:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-5701c6f1-a96f-4b46-bc02-5a61be367194 req-c8967bc4-6f1b-41eb-8e12-66d0d6b9b88a tempest-ServerBootFromVolumeStableRescueTest-422758966 None] attachment_update completed successfully. Apr 15 10:12:05 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:05 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack sudo[86248]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727" returned: 0 in 0.495s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727 Apr 15 10:12:05 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.491s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:06 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 1G Apr 15 10:12:06 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-57ee801d-badb-4ece-90a8-2ef588a18727" returned: 0 in 0.469s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Lock "cinder-quobyte-57ee801d-badb-4ece-90a8-2ef588a18727" released by "delete_volume" :: held 1.021s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Created reservations ['35234c73-5fc9-4cf6-9e2d-e6785a8bb18a', 'fab00da7-4a5a-46d1-b295-95b5e0a22571', 'cbbdc2e5-e61c-4814-8b83-7a3bc6c46117', '53df26a4-56e5-4b36-9067-68e3eb92223a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:06 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:06 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 1G" returned: 0 in 0.640s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:06 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 Apr 15 10:12:06 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.549s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Deleted volume successfully. Apr 15 10:12:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ce8a26b3-7047-4c15-9569-e332a564f63d tempest-VolumesActionsTest-806879594 None] Lock "cinder-57ee801d-badb-4ece-90a8-2ef588a18727-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:07 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75" returned: 0 in 0.473s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 is being set with open permissions: ugo+rw Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 Apr 15 10:12:07 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (a07b75f1-d760-4386-b618-bfbedea69095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3714d24-7d36-4764-a39e-a6d9ba3e2ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3714d24-7d36-4764-a39e-a6d9ba3e2ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-515733030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b835aa-0ed9-4959-abef-4d78d3761432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:08Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb5172-5cc2-4add-874e-ded95b011e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb5172-5cc2-4add-874e-ded95b011e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279cfd49-fea5-4792-bb0c-f45d77a619f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279cfd49-fea5-4792-bb0c-f45d77a619f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b835aa-0ed9-4959-abef-4d78d3761432', 'volume_name': 'volume-e7b835aa-0ed9-4959-abef-4d78d3761432', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513aa17c-c379-433b-8aec-a3ea1cb046b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513aa17c-c379-433b-8aec-a3ea1cb046b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8200a64f-e5ae-40ce-9d77-48acc63caf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Volume e7b835aa-0ed9-4959-abef-4d78d3761432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b835aa-0ed9-4959-abef-4d78d3761432', 'volume_size': 1} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:07 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75" returned: 0 in 0.570s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.196s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1645952927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ab1b477-ac87-4847-8ede-14781f5fe84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e792c7bfde84597a687a08bbd6f6aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:05Z,use_quota=True,user_id='c434e1da607d442a907a80a2559809be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Creating volume 9ab1b477-ac87-4847-8ede-14781f5fe84d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:07 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d 1073741824 Apr 15 10:12:07 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f390f0ad-d31c-4752-ad67-6a69013c784e tempest-SnapshotsActionsTest-1465220904 None] Create snapshot completed successfully Apr 15 10:12:08 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d 1073741824" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d Apr 15 10:12:08 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-17af766f-6848-4561-a95b-73d95021aa75-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-17af766f-6848-4561-a95b-73d95021aa75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-17af766f-6848-4561-a95b-73d95021aa75" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:08 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.047s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-515733030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b835aa-0ed9-4959-abef-4d78d3761432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39efc423c341d2b74d3b4a702232a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:08Z,use_quota=True,user_id='50bd94dc805c4283aa544d28939b93a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Creating volume e7b835aa-0ed9-4959-abef-4d78d3761432 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:08 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44844cf9-d116-4e5c-abe4-99944687e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ab1b477-ac87-4847-8ede-14781f5fe84d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc982e21-e94b-4c98-8bab-74ed1ef3e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:08 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 1073741824 Apr 15 10:12:08 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-17af766f-6848-4561-a95b-73d95021aa75" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Deleting offline snapshot 17af766f-6848-4561-a95b-73d95021aa75 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] snapshot_file for this snap is: volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43652f1-3ef0-481e-a68c-d92f99fb30f3]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Volume volume-9ab1b477-ac87-4847-8ede-14781f5fe84d (9ab1b477-ac87-4847-8ede-14781f5fe84d): created successfully Apr 15 10:12:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc982e21-e94b-4c98-8bab-74ed1ef3e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Flow 'volume_create_manager' (aab1fb5f-19dc-4ab1-a7a4-177b4db88ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-aab7a045-4cd6-4ac2-af35-3b7c1aa1e310 tempest-VolumesTransfersV357Test-781803786 None] Created volume successfully. Apr 15 10:12:09 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 Apr 15 10:12:09 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 1073741824" returned: 0 in 0.538s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:09 devstack sudo[86301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 Apr 15 10:12:09 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75" returned: 0 in 0.550s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36008c58-86ea-454a-9427-3b555a4ac13c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:09 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:09 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8200a64f-e5ae-40ce-9d77-48acc63caf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b835aa-0ed9-4959-abef-4d78d3761432', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0c157b-6672-4809-9d75-7b4cd5bf4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Volume volume-e7b835aa-0ed9-4959-abef-4d78d3761432 (e7b835aa-0ed9-4959-abef-4d78d3761432): created successfully Apr 15 10:12:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0c157b-6672-4809-9d75-7b4cd5bf4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Flow 'volume_create_manager' (a07b75f1-d760-4386-b618-bfbedea69095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b248c714-0302-4cbc-9a77-cf6868a65e01 tempest-VolumesActionsTest-1729292014 None] Created volume successfully. Apr 15 10:12:10 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.589s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:10 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 Apr 15 10:12:10 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a7f314d0-c508-433e-b59f-a283973d5516 tempest-VolumesTransfersV357Test-853639747 None] Transfer volume completed successfully. Apr 15 10:12:11 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75" returned: 0 in 0.925s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:11 devstack sudo[86340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75 Apr 15 10:12:11 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Acquiring lock "cinder-9ab1b477-ac87-4847-8ede-14781f5fe84d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-9ab1b477-ac87-4847-8ede-14781f5fe84d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Acquiring lock "cinder-e7b835aa-0ed9-4959-abef-4d78d3761432-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Lock "cinder-e7b835aa-0ed9-4959-abef-4d78d3761432-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Acquiring lock "cinder-quobyte-9ab1b477-ac87-4847-8ede-14781f5fe84d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-quobyte-9ab1b477-ac87-4847-8ede-14781f5fe84d" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500dff9-a91f-4e44-9742-871e51618c69]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Acquiring lock "cinder-quobyte-e7b835aa-0ed9-4959-abef-4d78d3761432" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Lock "cinder-quobyte-e7b835aa-0ed9-4959-abef-4d78d3761432" acquired by "delete_volume" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e23d553-ee22-4b41-90fa-1c4ddd60697a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:12 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.17af766f-6848-4561-a95b-73d95021aa75" returned: 0 in 1.294s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-17af766f-6848-4561-a95b-73d95021aa75" released by "_delete_snapshot" :: held 3.425s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" released by "delete_snapshot" :: held 3.482s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:12 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d Apr 15 10:12:12 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:12 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 Apr 15 10:12:12 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Created reservations ['b202da83-c6e3-4235-b029-3d3bd246bdc4', '2faf9c62-e72f-4330-9fff-7a097a0eda35', 'e5644c0e-530f-47ac-b67d-538d8f49265c', '2df2f2f2-03eb-4dfa-8aee-f8b190c4ab05'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Delete snapshot completed successfully. Apr 15 10:12:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-33920ae7-738c-4a03-8891-236563927d47 tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-17af766f-6848-4561-a95b-73d95021aa75-delete_snapshot" released by "delete_snapshot" :: held 3.625s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:13 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d" returned: 0 in 0.774s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:13 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d Apr 15 10:12:13 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:13 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432" returned: 0 in 0.781s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:13 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432 Apr 15 10:12:13 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Creating offline snapshot 2268a2bd-1220-4641-97db-a0e11f45e1a6 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55fdf7b-b64b-4f43-af33-81588aa805d0]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:13 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:13 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9ab1b477-ac87-4847-8ede-14781f5fe84d" returned: 0 in 1.088s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-quobyte-9ab1b477-ac87-4847-8ede-14781f5fe84d" released by "delete_volume" :: held 1.934s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Created reservations ['6b54f600-9f62-4bf6-8eba-1a6339e65b4b', 'fc419d10-60a6-4411-b024-abc52532edb4', '807e75e3-a6ca-4be4-bbc0-af907bb1acdc', 'd756a5f9-ee36-4012-9693-f9e4e78fee71'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:14 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e7b835aa-0ed9-4959-abef-4d78d3761432" returned: 0 in 1.198s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Lock "cinder-quobyte-e7b835aa-0ed9-4959-abef-4d78d3761432" released by "delete_volume" :: held 2.041s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:14 devstack sudo[86368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:14 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:14 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.735s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Created reservations ['5ef030ce-b2ad-4db7-9478-edaca9406b9c', 'c398028f-437d-4db4-aa49-394be7fccb68', '338d7b30-ad74-4685-a092-67cf55cb7a2d', 'fcc1d97e-039c-4024-a0e8-ee6b3107827f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:14 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 1G Apr 15 10:12:14 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:14 devstack sudo[86372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:14 devstack sudo[86372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Flow 'volume_create_manager' (2abe6a22-c090-41f0-82e4-ef97f5c04223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f059f23-c0bb-4055-abc3-b94083cea7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f059f23-c0bb-4055-abc3-b94083cea7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-758671125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6093c4-80eb-46c0-acf2-5b4604dd004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e792c7bfde84597a687a08bbd6f6aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:15Z,use_quota=True,user_id='c434e1da607d442a907a80a2559809be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1c44fc-50eb-4bf2-977d-f061dc25692c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1c44fc-50eb-4bf2-977d-f061dc25692c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02cd72e-aa95-4518-b633-75baf6c7da08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02cd72e-aa95-4518-b633-75baf6c7da08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6093c4-80eb-46c0-acf2-5b4604dd004f', 'volume_name': 'volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe2385-6b3b-46ed-8d87-bdfe4daff33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febe2385-6b3b-46ed-8d87-bdfe4daff33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0c5ffa-95b2-47fa-9d30-9d74b48f7d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Volume 4f6093c4-80eb-46c0-acf2-5b4604dd004f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f', 'volume_size': 1} Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:15 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.817s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Deleted volume successfully. Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b29ce441-6307-434f-a021-b671119a0b28 tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-9ab1b477-ac87-4847-8ede-14781f5fe84d-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:15 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 1G" returned: 0 in 0.898s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[86372]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.773s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:15 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 Apr 15 10:12:15 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Deleted volume successfully. Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c0d8ed36-7cf7-44bc-a912-d4047e0f084d tempest-VolumesActionsTest-1729292014 None] Lock "cinder-e7b835aa-0ed9-4959-abef-4d78d3761432-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:15 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6" returned: 0 in 0.547s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 is being set with open permissions: ugo+rw Apr 15 10:12:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 Apr 15 10:12:15 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.334s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-758671125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6093c4-80eb-46c0-acf2-5b4604dd004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e792c7bfde84597a687a08bbd6f6aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:15Z,use_quota=True,user_id='c434e1da607d442a907a80a2559809be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Creating volume 4f6093c4-80eb-46c0-acf2-5b4604dd004f {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:16 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e9246ef1-1443-4150-93bc-167bd8ef7e16 tempest-SnapshotsActionsTest-1465220904 None] Create snapshot completed successfully Apr 15 10:12:16 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f 1073741824 Apr 15 10:12:16 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-2268a2bd-1220-4641-97db-a0e11f45e1a6-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-2268a2bd-1220-4641-97db-a0e11f45e1a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-2268a2bd-1220-4641-97db-a0e11f45e1a6" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-2268a2bd-1220-4641-97db-a0e11f45e1a6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Deleting offline snapshot 2268a2bd-1220-4641-97db-a0e11f45e1a6 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] snapshot_file for this snap is: volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47325c-47a6-4cb5-8132-f1dc7aeb4c5d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 Apr 15 10:12:17 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f 1073741824" returned: 0 in 0.839s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f Apr 15 10:12:17 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6" returned: 0 in 0.793s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ff504-3aa6-4bd5-a092-87f2af3cfdd9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:17 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f" returned: 0 in 0.631s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0c5ffa-95b2-47fa-9d30-9d74b48f7d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42490d5a-cab7-47f7-9786-a038abd2bdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Volume volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f (4f6093c4-80eb-46c0-acf2-5b4604dd004f): created successfully Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42490d5a-cab7-47f7-9786-a038abd2bdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Flow 'volume_create_manager' (2abe6a22-c090-41f0-82e4-ef97f5c04223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-202537f8-d883-4284-b317-9e2e5ae08c89 tempest-VolumesTransfersV357Test-781803786 None] Created volume successfully. Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Acquiring lock "cinder-4f6093c4-80eb-46c0-acf2-5b4604dd004f-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.780s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-4f6093c4-80eb-46c0-acf2-5b4604dd004f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 Apr 15 10:12:18 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Acquiring lock "cinder-quobyte-4f6093c4-80eb-46c0-acf2-5b4604dd004f" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-quobyte-4f6093c4-80eb-46c0-acf2-5b4604dd004f" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d0afe5-8b96-4829-97a3-15f92a6c2ef5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f Apr 15 10:12:18 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6" returned: 0 in 0.681s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6 Apr 15 10:12:19 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f" returned: 0 in 0.641s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f Apr 15 10:12:19 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f6093c4-80eb-46c0-acf2-5b4604dd004f" returned: 0 in 0.661s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-quobyte-4f6093c4-80eb-46c0-acf2-5b4604dd004f" released by "delete_volume" :: held 1.328s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:20 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.2268a2bd-1220-4641-97db-a0e11f45e1a6" returned: 0 in 0.790s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Created reservations ['602409e5-999a-445f-a547-e274e251874c', '2ee63b34-ab2a-42f2-8fdb-7fd0671df8d4', 'afcbbe4d-b104-447b-80b2-2ecbd56a3e66', 'b93b4d16-ad3f-4140-8176-b7b8e82d3875'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-2268a2bd-1220-4641-97db-a0e11f45e1a6" released by "_delete_snapshot" :: held 3.196s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" released by "delete_snapshot" :: held 3.225s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:20 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:20 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Created reservations ['80bda4a1-48a0-4384-9e63-9248da5f7741', 'b158f7fb-b430-4b3c-b610-f01e230f38c2', '11e0ac28-3757-4008-bba1-f450db07b14c', '851663c6-4c40-47fc-89cb-c6053b4322cc'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Delete snapshot completed successfully. Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7b0f0c74-cde5-4e7b-ae20-4133ad93cc5e tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-2268a2bd-1220-4641-97db-a0e11f45e1a6-delete_snapshot" released by "delete_snapshot" :: held 3.394s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:20 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.523s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Deleted volume successfully. Apr 15 10:12:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b130275-6169-41c0-9185-7913471df46e tempest-VolumesTransfersV357Test-90771144 None] Lock "cinder-4f6093c4-80eb-46c0-acf2-5b4604dd004f-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Creating offline snapshot 034edad2-a53e-4e4d-baac-ebc1c7da9045 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[65224ef5-687d-488c-bbe0-1ab0e3e37b3d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:21 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:21 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:22 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.579s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:22 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 1G Apr 15 10:12:22 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:22 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 1G" returned: 0 in 0.730s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:22 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 Apr 15 10:12:22 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:23 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045" returned: 0 in 0.635s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:23 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 is being set with open permissions: ugo+rw Apr 15 10:12:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:23 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 Apr 15 10:12:23 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:23 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045" returned: 0 in 0.532s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-893a11cd-a705-45c2-a69e-a37085b29f03 tempest-SnapshotsActionsTest-1465220904 None] Create snapshot completed successfully Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-034edad2-a53e-4e4d-baac-ebc1c7da9045-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-034edad2-a53e-4e4d-baac-ebc1c7da9045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-034edad2-a53e-4e4d-baac-ebc1c7da9045" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-034edad2-a53e-4e4d-baac-ebc1c7da9045" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Deleting offline snapshot 034edad2-a53e-4e4d-baac-ebc1c7da9045 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] snapshot_file for this snap is: volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ff421-0154-4d47-bf76-9c391068f173]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:25 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 Apr 15 10:12:25 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:25 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045" returned: 0 in 0.943s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd62a612-21e6-40cc-afc3-34d4bc446859]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:26 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:26 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Flow 'volume_create_manager' (d3b7b693-eb0a-4e88-a4db-ee83c23bb51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7391101f-1e87-4d80-8add-65ecbd8e09c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7391101f-1e87-4d80-8add-65ecbd8e09c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-508051308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352b7dd2-b286-46ac-a750-b0a32e5d8c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17350f9f9b2e45ef97eca79a0f4e7caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:26Z,use_quota=True,user_id='8ba6a8c8c6164978b9e58e4f7737ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b5ee9-4d20-4409-8e03-db0b7d1d7c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205b5ee9-4d20-4409-8e03-db0b7d1d7c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78323083-ea18-400a-ab44-fe0fab2cb1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.image.glance [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Creating Keystone auth plugin from conf {{(pid=82850) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:12:26 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.783s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:26 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 Apr 15 10:12:26 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78323083-ea18-400a-ab44-fe0fab2cb1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '352b7dd2-b286-46ac-a750-b0a32e5d8c41', 'volume_name': 'volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ba3394-6d96-4fe2-878c-9b57bd85d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ba3394-6d96-4fe2-878c-9b57bd85d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f029632-8735-42f9-919d-7850bfdb0c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:26 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Volume 352b7dd2-b286-46ac-a750-b0a32e5d8c41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:12:26 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Trying to clone 352b7dd2-b286-46ac-a750-b0a32e5d8c41 from image 019e5b32-dfb6-4970-afa1-ec198cc6628d at location (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:12:27 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a72876-6b2f-49bb-9da2-fa597fdebed4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD Apr 15 10:12:27 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:27 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Flow 'volume_create_manager' (f713173e-20c7-498f-93c8-f8d767c4e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e5f04f-7fe4-4142-9e80-0b74316d7369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045" returned: 0 in 0.771s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045 Apr 15 10:12:27 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e5f04f-7fe4-4142-9e80-0b74316d7369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469909142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbbb206-f4a3-4cd4-a91f-6c0301d109c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d19e054a814f8b84d5cc2104f3d73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:27Z,use_quota=True,user_id='b737e3dca2b84fd496553a2fdcde6d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f1a30a-9734-4f10-858c-84ddd9a63729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f1a30a-9734-4f10-858c-84ddd9a63729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38db4d3-7874-485b-9d4a-dbb7d846a7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38db4d3-7874-485b-9d4a-dbb7d846a7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbbb206-f4a3-4cd4-a91f-6c0301d109c3', 'volume_name': 'volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce46275-fd55-4bb0-a20d-1a6d20069210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce46275-fd55-4bb0-a20d-1a6d20069210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf36405-64a4-424a-8eff-215dbf8fc11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Volume 4fbbb206-f4a3-4cd4-a91f-6c0301d109c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3', 'volume_size': 1} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469909142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbbb206-f4a3-4cd4-a91f-6c0301d109c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d19e054a814f8b84d5cc2104f3d73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:27Z,use_quota=True,user_id='b737e3dca2b84fd496553a2fdcde6d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Creating volume 4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:27 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 1073741824 Apr 15 10:12:27 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d is fetched for user 8ba6a8c8c6164978b9e58e4f7737ee83. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b4167-09fd-413e-aed6-2c9620d7215a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:28 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD Apr 15 10:12:28 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:28 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.034edad2-a53e-4e4d-baac-ebc1c7da9045" returned: 0 in 0.564s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-034edad2-a53e-4e4d-baac-ebc1c7da9045" released by "_delete_snapshot" :: held 3.155s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" released by "delete_snapshot" :: held 3.197s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:28 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 1073741824" returned: 0 in 0.586s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Created reservations ['e2de8e05-2049-4151-b137-ae4124640187', '2632bf8c-45ce-4d86-bad9-50cb6b954fda', '7455c8fb-88c5-4626-88b8-30134228dad3', 'fe60c465-a2ab-419f-8aef-e6ee3b925a06'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Delete snapshot completed successfully. Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f0bd3b2a-878e-4635-80e1-8235bbc3e67a tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-034edad2-a53e-4e4d-baac-ebc1c7da9045-delete_snapshot" released by "delete_snapshot" :: held 3.435s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:28 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 Apr 15 10:12:28 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:28 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD" returned: 0 in 0.709s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:28 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3" returned: 0 in 0.603s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-508051308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352b7dd2-b286-46ac-a750-b0a32e5d8c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17350f9f9b2e45ef97eca79a0f4e7caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:26Z,use_quota=True,user_id='8ba6a8c8c6164978b9e58e4f7737ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Creating volume 352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:28 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:28 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 1073741824 Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf36405-64a4-424a-8eff-215dbf8fc11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a753115-f8e1-499d-9512-502f852f09b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Volume volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 (4fbbb206-f4a3-4cd4-a91f-6c0301d109c3): created successfully Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a753115-f8e1-499d-9512-502f852f09b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Flow 'volume_create_manager' (f713173e-20c7-498f-93c8-f8d767c4e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-925b479e-b4df-4d81-80af-da88fd3c0699 tempest-VolumesTransfersV355Test-1339647099 None] Created volume successfully. Apr 15 10:12:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:29 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 1073741824" returned: 0 in 0.576s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:29 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:29 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 0 in 0.612s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.764s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Creating offline snapshot a6559476-cd26-45a7-984d-376c35088fe0 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Attempting download of 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 352b7dd2-b286-46ac-a750-b0a32e5d8c41. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c63f6c-3910-483d-9d27-002a28028937]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7428e-ec88-4ed5-974a-3ed1ca313603]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_z_k_zt7d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-365ddcaf-df11-44dd-935a-83dd2b6c14d0 tempest-VolumesTransfersV355Test-1609282570 None] Transfer volume completed successfully. Apr 15 10:12:30 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:30 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_z_k_zt7d Apr 15 10:12:30 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:31 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_z_k_zt7d" returned: 0 in 0.756s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_z_k_zt7d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.866s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack sudo[86703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 1G Apr 15 10:12:31 devstack sudo[86703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:31 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_z_k_zt7d Apr 15 10:12:31 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Acquiring lock "cinder-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Acquiring lock "cinder-quobyte-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-quobyte-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390618b-5c32-4aa2-ae45-ff5947147dd9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 Apr 15 10:12:31 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:31 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_z_k_zt7d" returned: 1 in 0.883s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_z_k_zt7d' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6987d4dc-4085-4477-8c99-7157a733a3a4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack sudo[86703]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 1G" returned: 0 in 0.880s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:31 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 Apr 15 10:12:31 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD Apr 15 10:12:32 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3" returned: 0 in 0.811s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:32 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3 Apr 15 10:12:32 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] 019e5b32-dfb6-4970-afa1-ec198cc6628d was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:32 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:32 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0" returned: 0 in 0.680s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:32 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 is being set with open permissions: ugo+rw Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:32 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 Apr 15 10:12:32 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:32 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3" returned: 0 in 0.681s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-quobyte-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3" released by "delete_volume" :: held 1.541s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:32 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Created reservations ['572e83b6-538d-4b49-9c07-829da2cce8a8', '490f5178-7fe5-49ff-bdb6-9632de2eea30', '73bdee21-0f93-4074-acef-999623d36874', '598683a4-6533-43c7-9d2a-cfe69345dad7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:33 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:33 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0" returned: 0 in 0.875s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.406s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3602854b-a9b3-4d49-a0ea-1bcd973eefcb tempest-SnapshotsActionsTest-1465220904 None] Create snapshot completed successfully Apr 15 10:12:33 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 0 in 1.459s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_4wqkf8gjdevstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:33 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Converted 112.00 MB image at 76.62 MB/s Apr 15 10:12:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:34 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 1G Apr 15 10:12:34 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Flow 'volume_create_manager' (ed3f0953-e382-49ff-a595-023d341cfe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee0f1c4-e60d-4d01-90f7-e703235733c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee0f1c4-e60d-4d01-90f7-e703235733c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-230490389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a330a5e7-e238-4a74-8bb6-69b2e1d38478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d19e054a814f8b84d5cc2104f3d73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:34Z,use_quota=True,user_id='b737e3dca2b84fd496553a2fdcde6d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047f8ad4-6bd1-4535-a4e8-6aec092dc05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047f8ad4-6bd1-4535-a4e8-6aec092dc05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e295db-4c7e-4721-866b-8d314b6845e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e295db-4c7e-4721-866b-8d314b6845e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a330a5e7-e238-4a74-8bb6-69b2e1d38478', 'volume_name': 'volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb62b58d-a32a-40d2-b547-9c89c6df483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb62b58d-a32a-40d2-b547-9c89c6df483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb94fe3-0292-45ad-8e92-ac95918c367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:34 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Volume a330a5e7-e238-4a74-8bb6-69b2e1d38478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478', 'volume_size': 1} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-230490389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a330a5e7-e238-4a74-8bb6-69b2e1d38478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d19e054a814f8b84d5cc2104f3d73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:34Z,use_quota=True,user_id='b737e3dca2b84fd496553a2fdcde6d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Creating volume a330a5e7-e238-4a74-8bb6-69b2e1d38478 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:34 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.871s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:34 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 1073741824 Apr 15 10:12:34 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:34 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.177s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Deleted volume successfully. Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a618a3cb-fc07-4ec5-9768-2a8cc90c9178 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-4fbbb206-f4a3-4cd4-a91f-6c0301d109c3-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:34 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 1G" returned: 0 in 0.686s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1f5813-98a4-417e-afc2-1c7eea7d1c69]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-a6559476-cd26-45a7-984d-376c35088fe0-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:34 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:34 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-a6559476-cd26-45a7-984d-376c35088fe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Acquiring lock "cinder-quobyte-a6559476-cd26-45a7-984d-376c35088fe0" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-a6559476-cd26-45a7-984d-376c35088fe0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Deleting offline snapshot a6559476-cd26-45a7-984d-376c35088fe0 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] snapshot_file for this snap is: volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[156a33ee-d1a7-42f1-a016-cdfdf958563f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 1073741824" returned: 0 in 0.740s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 Apr 15 10:12:34 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:34 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 Apr 15 10:12:34 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:35 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 0 in 0.678s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:35 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0" returned: 0 in 0.554s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36abf1c-b411-46d1-a592-b608394665dc]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:35 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:35 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:35 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb94fe3-0292-45ad-8e92-ac95918c367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961a72ac-68df-4a77-8797-73cfcbe47554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:35 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Volume volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 (a330a5e7-e238-4a74-8bb6-69b2e1d38478): created successfully Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961a72ac-68df-4a77-8797-73cfcbe47554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Flow 'volume_create_manager' (ed3f0953-e382-49ff-a595-023d341cfe7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-64dd2b9f-881a-4035-855e-76ea8afa2145 tempest-VolumesTransfersV355Test-1339647099 None] Created volume successfully. Apr 15 10:12:35 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:35 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:35 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 1 in 0.543s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Downloaded image 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 352b7dd2-b286-46ac-a750-b0a32e5d8c41 successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d for user 8ba6a8c8c6164978b9e58e4f7737ee83 is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Marking volume 352b7dd2-b286-46ac-a750-b0a32e5d8c41 as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Copying metadata from image 019e5b32-dfb6-4970-afa1-ec198cc6628d to 352b7dd2-b286-46ac-a750-b0a32e5d8c41. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:12:35 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Creating volume glance metadata for volume 352b7dd2-b286-46ac-a750-b0a32e5d8c41 backed by image 019e5b32-dfb6-4970-afa1-ec198cc6628d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:12:36 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.578s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:36 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 Apr 15 10:12:36 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f029632-8735-42f9-919d-7850bfdb0c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49431db4-22e6-4335-9392-59aaa730c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:36 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Volume volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 (352b7dd2-b286-46ac-a750-b0a32e5d8c41): created successfully Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49431db4-22e6-4335-9392-59aaa730c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Flow 'volume_create_manager' (d3b7b693-eb0a-4e88-a4db-ee83c23bb51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-aa99b11b-102d-4b95-8123-167b5f8bde8b tempest-VolumesExtendTest-1221856876 None] Created volume successfully. Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Acquiring lock "cinder-a330a5e7-e238-4a74-8bb6-69b2e1d38478-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-a330a5e7-e238-4a74-8bb6-69b2e1d38478-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Acquiring lock "cinder-quobyte-a330a5e7-e238-4a74-8bb6-69b2e1d38478" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-quobyte-a330a5e7-e238-4a74-8bb6-69b2e1d38478" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426247c-d52b-437b-bbcd-36c8e416539e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:36 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 Apr 15 10:12:36 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:36 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0" returned: 0 in 0.649s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:36 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0 Apr 15 10:12:36 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478" returned: 0 in 0.537s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:37 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478 Apr 15 10:12:37 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-6111dde2-5a98-451c-8773-41437e626a55 req-9db42f5c-deab-467d-86bf-2326eebcae94 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Terminate volume connection completed successfully. Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-6111dde2-5a98-451c-8773-41437e626a55 req-9db42f5c-deab-467d-86bf-2326eebcae94 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Deleting attachment ef450e8c-4683-4fc6-a210-a9b9403fdb3f. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:12:37 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.a6559476-cd26-45a7-984d-376c35088fe0" returned: 0 in 0.479s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-a6559476-cd26-45a7-984d-376c35088fe0" released by "_delete_snapshot" :: held 2.314s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" released by "delete_snapshot" :: held 2.329s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Created reservations ['19652aa1-8ae2-47bb-902c-eb5d6b317357', '0b605d46-4a97-4c4a-abbe-93df67b44a2d', '92182981-58de-4a08-9535-cc1a3f6ce3d4', '4f22af99-c36a-4c81-95b2-5983a75e96ab'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Delete snapshot completed successfully. Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b0c3771-dc27-4061-b975-ca5eea2f7cba tempest-SnapshotsActionsTest-1291939711 None] Lock "cinder-a6559476-cd26-45a7-984d-376c35088fe0-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d636216a-d665-4bf1-ac76-2e3f2adcb732]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:37 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:37 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a330a5e7-e238-4a74-8bb6-69b2e1d38478" returned: 0 in 0.615s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-quobyte-a330a5e7-e238-4a74-8bb6-69b2e1d38478" released by "delete_volume" :: held 1.187s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "cinder-749981fb-1a7f-43e3-a3f5-fdd2a33a598a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Created reservations ['fa7d33d8-e7b2-4ff2-b3e7-498f174f1021', '4471affc-562c-427a-a8b2-915a449d4cd2', '6290dfbe-7ff9-45fb-ae29-cfd9780c6f4c', '289f1432-177e-40b2-bf75-9f4dc03ca3bd'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-749981fb-1a7f-43e3-a3f5-fdd2a33a598a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "cinder-quobyte-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-quobyte-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e559ab65-4437-455e-b4a3-78fdb695bb0e]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:37 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:37 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:12:37 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 0 in 0.583s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:38 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:38 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "cinder-6ae7c4b4-34c7-448a-8e26-f7a6397e0249-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-6ae7c4b4-34c7-448a-8e26-f7a6397e0249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "cinder-quobyte-6ae7c4b4-34c7-448a-8e26-f7a6397e0249" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-quobyte-6ae7c4b4-34c7-448a-8e26-f7a6397e0249" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Deleting offline snapshot 6ae7c4b4-34c7-448a-8e26-f7a6397e0249 of volume b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] snapshot_file for this snap is: volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e74809-9ec1-4d36-aac1-0ab08d91af0c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:38 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:38 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:38 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.733s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Deleted volume successfully. Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c396b7e8-d7df-43c7-a0e3-a042afe1fa15 tempest-VolumesTransfersV355Test-673743097 None] Lock "cinder-a330a5e7-e238-4a74-8bb6-69b2e1d38478-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:38 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 0 in 0.789s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:38 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:12:38 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:38 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 1 in 0.781s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 2G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 2G" returned: 0 in 0.055s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.462s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9784cf30-dd5b-4712-b5c7-ad88d113cdfe tempest-VolumesExtendTest-1221856876 None] Extend volume completed successfully. Apr 15 10:12:39 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.646s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd51d34-5e49-4ab3-843d-d7cacc7adf68]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a Apr 15 10:12:39 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:39 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 1 in 0.598s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a Apr 15 10:12:39 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "cinder-352b7dd2-b286-46ac-a750-b0a32e5d8c41-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-352b7dd2-b286-46ac-a750-b0a32e5d8c41-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "cinder-quobyte-352b7dd2-b286-46ac-a750-b0a32e5d8c41" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-352b7dd2-b286-46ac-a750-b0a32e5d8c41" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:39 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" returned: 0 in 0.651s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:39 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" returned: 0 in 0.791s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbedd5-88b9-44ae-98b9-faa43fa1e163]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-quobyte-749981fb-1a7f-43e3-a3f5-fdd2a33a598a" released by "delete_volume" :: held 2.112s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:39 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG cinder.quota [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Created reservations ['14b2e2d0-6e82-4d4f-805d-0bf1a76dfb7d', 'ba1390f8-cee5-4ac6-a532-3c15b4fe9099', 'fe817a2e-8144-472d-95d6-b619a26f3262', '41ed244a-ee4f-42d5-8ed2-115b17ba8e0c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:40 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:40 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:40 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:40 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 0 in 0.669s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:40 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.520s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG cinder.manager [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Deleted volume successfully. Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-6111dde2-5a98-451c-8773-41437e626a55 req-43ee6f25-20f0-4317-9af8-6955451ed42e tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-749981fb-1a7f-43e3-a3f5-fdd2a33a598a-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:40 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.779s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:40 devstack sudo[86876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:40 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249 Apr 15 10:12:40 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:41 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 1 in 0.659s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:41 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41 Apr 15 10:12:41 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:41 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a.6ae7c4b4-34c7-448a-8e26-f7a6397e0249" returned: 0 in 0.608s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-quobyte-6ae7c4b4-34c7-448a-8e26-f7a6397e0249" released by "_delete_snapshot" :: held 2.918s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" released by "delete_snapshot" :: held 2.933s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Created reservations ['848b9b73-25ff-465e-8b6c-6d9d4c3cbb3f', '95468513-47dd-48c4-a61b-5b79a347716d', '1e8032da-5713-4964-b86b-2326d9d3bb9d', '227d7c2b-84d5-482b-8eb1-2d3c4b07a213'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Delete snapshot completed successfully. Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ddf8f034-c83b-4110-aee9-f7e54fab445e tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-6ae7c4b4-34c7-448a-8e26-f7a6397e0249-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "cinder-b7f374cf-0216-4967-a336-2cbf7b1f4c5a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-b7f374cf-0216-4967-a336-2cbf7b1f4c5a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9353564-b2be-4717-a19d-392650e1d7aa]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:41 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a Apr 15 10:12:41 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:41 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-352b7dd2-b286-46ac-a750-b0a32e5d8c41" returned: 0 in 0.672s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-352b7dd2-b286-46ac-a750-b0a32e5d8c41" released by "delete_volume" :: held 2.064s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:41 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Created reservations ['8f7d41f2-0029-4afd-a6ab-3517f2edf0e7', '0c6f6df9-08db-452e-af7f-910f9c63bfd6', 'a90c6b5e-3dfe-4d49-bc9c-6df4f57a21af', 'e1b31e63-2fe6-406c-b638-0af3a6234148'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:42 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" returned: 0 in 0.671s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a Apr 15 10:12:42 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.617s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Deleted volume successfully. Apr 15 10:12:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f08676b0-cb65-45a0-bdcd-b3944fb58019 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-352b7dd2-b286-46ac-a750-b0a32e5d8c41-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:43 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" returned: 0 in 0.731s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-quobyte-b7f374cf-0216-4967-a336-2cbf7b1f4c5a" released by "delete_volume" :: held 1.470s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Flow 'volume_create_manager' (8d3ee502-f610-46ea-837f-3c57cfebcea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (362b45eb-abcc-4d84-9c0e-99c348401ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (362b45eb-abcc-4d84-9c0e-99c348401ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1763423788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2aeca64-dbc8-4648-bf48-3727445f01d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a49a61faada4025a6fdf1c24849d451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:43Z,use_quota=True,user_id='a898aa2e72aa46ac969c9528561ebbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041dad09-8dbd-42d0-b644-498356e90e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041dad09-8dbd-42d0-b644-498356e90e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2d7e90-e6a0-4140-a19e-7e48bf8d2ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2d7e90-e6a0-4140-a19e-7e48bf8d2ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2aeca64-dbc8-4648-bf48-3727445f01d4', 'volume_name': 'volume-b2aeca64-dbc8-4648-bf48-3727445f01d4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e9853-9459-4eb3-a140-98fcf1c157a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e9853-9459-4eb3-a140-98fcf1c157a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fd160d-f96f-4193-bc9f-bfa6f68fa249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Volume b2aeca64-dbc8-4648-bf48-3727445f01d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2aeca64-dbc8-4648-bf48-3727445f01d4', 'volume_size': 1} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1763423788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2aeca64-dbc8-4648-bf48-3727445f01d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a49a61faada4025a6fdf1c24849d451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:43Z,use_quota=True,user_id='a898aa2e72aa46ac969c9528561ebbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Creating volume b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:43 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 1073741824 Apr 15 10:12:43 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Created reservations ['bc01b6ef-a342-4ee1-b046-f7386198a2c5', '7663b702-4540-4875-bb63-877a8014cef0', '44c595ca-bdd1-4092-9fab-5f95586cdf90', '09843f55-09ef-4ba3-9b8c-14cb8dc00aee'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Flow 'volume_create_manager' (e3bd881b-df19-4e25-ad5c-2d669a22fa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0861f061-617e-463a-9800-b1df7ed8547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0861f061-617e-463a-9800-b1df7ed8547a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-620382789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab6186f-354b-45e1-a9e1-04bf4be919ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17350f9f9b2e45ef97eca79a0f4e7caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:43Z,use_quota=True,user_id='8ba6a8c8c6164978b9e58e4f7737ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b1ea9d-4228-44cf-bcd6-29631b7540ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b1ea9d-4228-44cf-bcd6-29631b7540ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a383be0-8b7c-46fe-af1c-f0f1020df414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a383be0-8b7c-46fe-af1c-f0f1020df414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ab6186f-354b-45e1-a9e1-04bf4be919ac', 'volume_name': 'volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8869f0d-431c-4b98-b28e-594e927221c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8869f0d-431c-4b98-b28e-594e927221c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02563bf5-8e69-45c4-b8c6-bd8d0331834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Volume 2ab6186f-354b-45e1-a9e1-04bf4be919ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac', 'volume_size': 1} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:43 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 1073741824" returned: 0 in 0.585s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 Apr 15 10:12:43 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.578s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Deleted volume successfully. Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-75299c02-2968-4adf-821d-134e742b1d15 tempest-SnapshotsActionsTest-1465220904 None] Lock "cinder-b7f374cf-0216-4967-a336-2cbf7b1f4c5a-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:44 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4" returned: 0 in 0.555s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-620382789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab6186f-354b-45e1-a9e1-04bf4be919ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17350f9f9b2e45ef97eca79a0f4e7caa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:43Z,use_quota=True,user_id='8ba6a8c8c6164978b9e58e4f7737ee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Creating volume 2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:44 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fd160d-f96f-4193-bc9f-bfa6f68fa249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2aeca64-dbc8-4648-bf48-3727445f01d4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7cc4f7-52d1-4439-a33c-1864875e1e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:44 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac 1073741824 Apr 15 10:12:44 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Volume volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 (b2aeca64-dbc8-4648-bf48-3727445f01d4): created successfully Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7cc4f7-52d1-4439-a33c-1864875e1e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Flow 'volume_create_manager' (8d3ee502-f610-46ea-837f-3c57cfebcea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0d0a5f6f-391f-461d-aa29-75e02a80067f tempest-VolumesCloneTest-1975245463 None] Created volume successfully. Apr 15 10:12:45 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac 1073741824" returned: 0 in 0.613s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:45 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac Apr 15 10:12:45 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Flow 'volume_create_manager' (baf883e0-ab2e-41e0-876d-ba090694af59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a6652b-cbca-49fb-946f-9e6c72046962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a6652b-cbca-49fb-946f-9e6c72046962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-302693043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e9c59e-522d-4da0-81db-17ced94203b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a49a61faada4025a6fdf1c24849d451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b2aeca64-dbc8-4648-bf48-3727445f01d4,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:46Z,use_quota=True,user_id='a898aa2e72aa46ac969c9528561ebbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e1fdeb-b38b-4857-98bf-9caa40897c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e1fdeb-b38b-4857-98bf-9caa40897c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b62ae5-d84e-48ef-80d5-70c8642c53f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac" returned: 0 in 0.639s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b62ae5-d84e-48ef-80d5-70c8642c53f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '43e9c59e-522d-4da0-81db-17ced94203b3', 'volume_name': 'volume-43e9c59e-522d-4da0-81db-17ced94203b3', 'volume_size': 2, 'source_volid': 'b2aeca64-dbc8-4648-bf48-3727445f01d4', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fd11fc-0045-4992-953b-1c60de2ebfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fd11fc-0045-4992-953b-1c60de2ebfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180a64b9-95e7-41fe-bfb3-9d88b2aa97d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Volume 43e9c59e-522d-4da0-81db-17ced94203b3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-43e9c59e-522d-4da0-81db-17ced94203b3', 'volume_size': 2, 'source_volid': 'b2aeca64-dbc8-4648-bf48-3727445f01d4', 'source_volstatus': 'available'} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02563bf5-8e69-45c4-b8c6-bd8d0331834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b31ff7-1662-42a7-80ff-cabf2c2149e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:45 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Cloning volume b2aeca64-dbc8-4648-bf48-3727445f01d4 to volume 43e9c59e-522d-4da0-81db-17ced94203b3 Apr 15 10:12:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Volume volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac (2ab6186f-354b-45e1-a9e1-04bf4be919ac): created successfully Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b31ff7-1662-42a7-80ff-cabf2c2149e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Flow 'volume_create_manager' (e3bd881b-df19-4e25-ad5c-2d669a22fa1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a27aa242-6710-4f54-8736-07ce13ebba90 tempest-VolumesExtendTest-1221856876 None] Created volume successfully. Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Creating offline snapshot 1ad85402-3ab4-4dd5-b8b3-973fc4967838 of volume b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1a0a51-9090-4ae8-bd75-f73f117ba63f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:45 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 Apr 15 10:12:45 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:46 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4" returned: 0 in 0.571s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:46 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 1G Apr 15 10:12:46 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:47 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 1G" returned: 0 in 0.634s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:47 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 Apr 15 10:12:47 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:47 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838" returned: 0 in 0.529s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:47 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 is being set with open permissions: ugo+rw Apr 15 10:12:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:47 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 Apr 15 10:12:47 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838" returned: 0 in 0.593s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.info Apr 15 10:12:48 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.info" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.info is being set with open permissions: ugo+rw Apr 15 10:12:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.info Apr 15 10:12:48 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.info" returned: 0 in 0.593s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Acquiring lock "cinder-quobyte-43e9c59e-522d-4da0-81db-17ced94203b3" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-43e9c59e-522d-4da0-81db-17ced94203b3" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] snapshot: 1ad85402-3ab4-4dd5-b8b3-973fc4967838, volume: 43e9c59e-522d-4da0-81db-17ced94203b3, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c2939-9171-4b43-891d-45ce22fd71fe]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:49 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 Apr 15 10:12:49 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:50 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838" returned: 0 in 0.595s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2aeca64-dbc8-4648-bf48-3727445f01d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d4e3f-ac8f-4d7d-a818-0a7ad2e1f559]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:50 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 Apr 15 10:12:50 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:50 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4" returned: 0 in 0.613s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:12:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:50 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 Apr 15 10:12:50 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-31196748-7262-4ae9-9f25-31310857aff8 req-415aee84-884c-4181-82da-219caadcf799 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Terminate volume connection completed successfully. Apr 15 10:12:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [req-31196748-7262-4ae9-9f25-31310857aff8 req-415aee84-884c-4181-82da-219caadcf799 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Deleting attachment d35001fb-afcc-4003-818c-a70145e80401. {{(pid=82850) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "cinder-28fdc0f9-62bf-4aab-9f07-e441dca95e99-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-28fdc0f9-62bf-4aab-9f07-e441dca95e99-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=175,cinder:SELECT=154,cinder:INSERT=50,cinder:DELETE=15 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=146,cinder:UPDATE=177,cinder:INSERT=59,cinder:DELETE=15 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "cinder-quobyte-28fdc0f9-62bf-4aab-9f07-e441dca95e99" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-quobyte-28fdc0f9-62bf-4aab-9f07-e441dca95e99" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538b3ad-58a3-49bf-93f6-6198312e544b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 Apr 15 10:12:53 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3" returned: 0 in 2.712s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f3118-e062-483b-8264-1956829776fb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 Apr 15 10:12:53 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99" returned: 0 in 0.920s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99 Apr 15 10:12:53 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4" returned: 0 in 0.686s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4, size 1024.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:54 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Converted 1024.00 MB image at 377.46 MB/s Apr 15 10:12:54 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 is being set with open permissions: ugo+rw Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:54 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 Apr 15 10:12:54 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-28fdc0f9-62bf-4aab-9f07-e441dca95e99" returned: 0 in 0.469s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-quobyte-28fdc0f9-62bf-4aab-9f07-e441dca95e99" released by "delete_volume" :: held 1.431s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.quota [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Created reservations ['3bf1df33-3246-4f34-b95d-999dbc031a93', 'c6484e44-3c04-40bf-94d9-39304ea9e214', 'b9445978-38cf-490f-928a-9cd42d5852ea', 'b8952470-10b5-41f0-9b3e-ab32774abb5a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:54 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:54 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3" returned: 0 in 0.589s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-43e9c59e-522d-4da0-81db-17ced94203b3" released by "_copy_volume_from_snapshot" :: held 5.269s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Acquiring lock "cinder-quobyte-1ad85402-3ab4-4dd5-b8b3-973fc4967838" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-1ad85402-3ab4-4dd5-b8b3-973fc4967838" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Deleting offline snapshot 1ad85402-3ab4-4dd5-b8b3-973fc4967838 of volume b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] snapshot_file for this snap is: volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4613fc9-4f9c-423b-a29b-1a821ed1801d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:54 devstack sudo[87055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 Apr 15 10:12:54 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.495s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.manager [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Deleted volume successfully. Apr 15 10:12:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [req-31196748-7262-4ae9-9f25-31310857aff8 req-04f63570-ba0b-4e64-b2a9-e7dabd39ef47 tempest-ServerBootFromVolumeStableRescueTest-422758966 None] Lock "cinder-28fdc0f9-62bf-4aab-9f07-e441dca95e99-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:55 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838" returned: 0 in 0.552s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2aeca64-dbc8-4648-bf48-3727445f01d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:55 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b9623-ec71-4826-a024-af2284461483]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:55 devstack sudo[87061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 Apr 15 10:12:55 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:55 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4" returned: 0 in 0.674s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:55 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 Apr 15 10:12:55 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:56 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:56 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838 Apr 15 10:12:56 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:57 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4.1ad85402-3ab4-4dd5-b8b3-973fc4967838" returned: 0 in 0.539s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-1ad85402-3ab4-4dd5-b8b3-973fc4967838" released by "_delete_snapshot" :: held 2.454s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.341s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.429s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Creating offline snapshot a00ff723-d914-4e84-a39c-87b8b1889db4 of volume 2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180a64b9-95e7-41fe-bfb3-9d88b2aa97d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e9c59e-522d-4da0-81db-17ced94203b3', 'volume_size': 2, 'source_volid': 'b2aeca64-dbc8-4648-bf48-3727445f01d4', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a953a9f-75a2-478f-86d9-f1d719facdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dfbd64-4d70-42ce-9664-080c1dec80a4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Volume volume-43e9c59e-522d-4da0-81db-17ced94203b3 (43e9c59e-522d-4da0-81db-17ced94203b3): created successfully Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a953a9f-75a2-478f-86d9-f1d719facdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Flow 'volume_create_manager' (baf883e0-ab2e-41e0-876d-ba090694af59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-bd58e91c-a258-4084-a2b1-c68e6e94a990 tempest-VolumesCloneTest-1975245463 None] Created volume successfully. Apr 15 10:12:57 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac Apr 15 10:12:57 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Acquiring lock "cinder-43e9c59e-522d-4da0-81db-17ced94203b3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-43e9c59e-522d-4da0-81db-17ced94203b3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Acquiring lock "cinder-quobyte-43e9c59e-522d-4da0-81db-17ced94203b3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-43e9c59e-522d-4da0-81db-17ced94203b3" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a0b0f-bfc2-4af1-af89-49a588bf9f48]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac" returned: 0 in 0.689s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 Apr 15 10:12:57 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:57 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 1G Apr 15 10:12:57 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 1G" returned: 0 in 0.568s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 Apr 15 10:12:58 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3" returned: 0 in 0.666s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3 Apr 15 10:12:58 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:59 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4" returned: 0 in 0.598s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:59 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 is being set with open permissions: ugo+rw Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:59 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 Apr 15 10:12:59 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:59 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-43e9c59e-522d-4da0-81db-17ced94203b3" returned: 0 in 0.595s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-43e9c59e-522d-4da0-81db-17ced94203b3" released by "delete_volume" :: held 1.289s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Created reservations ['48176abe-f313-4a8f-bb1d-bd1933af8d87', 'b0430da2-a2fa-4dc5-a9b0-34c2cde12c9a', '095f7e41-f9d4-481f-bec4-aace0884fd17', '2be08090-515b-4973-a9c9-13f9d64d7769'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:59 devstack sudo[87129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:12:59 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Flow 'volume_create_manager' (d3e365c2-886f-488a-9d1d-2115662c72cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13337635-440d-414d-8285-28684f778e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13337635-440d-414d-8285-28684f778e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1213374574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979c8efd-c4ce-4679-9557-a213572e9c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f453a925c948b0bd35ac679abdae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:59Z,use_quota=True,user_id='351bff97a9524ea4a3928017f1447d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a9253b-88d2-46d9-beac-7211b2e770df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a9253b-88d2-46d9-beac-7211b2e770df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e13170-cc3d-4d72-8754-4c45df20ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e13170-cc3d-4d72-8754-4c45df20ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979c8efd-c4ce-4679-9557-a213572e9c96', 'volume_name': 'volume-979c8efd-c4ce-4679-9557-a213572e9c96', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73801df0-cffc-4b7d-91af-3f2057a5ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73801df0-cffc-4b7d-91af-3f2057a5ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed082cf8-520a-4c57-b663-4aa0fcef9dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Volume 979c8efd-c4ce-4679-9557-a213572e9c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979c8efd-c4ce-4679-9557-a213572e9c96', 'volume_size': 1} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:59 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4" returned: 0 in 0.486s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:59 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.info Apr 15 10:12:59 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:59 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Deleted volume successfully. Apr 15 10:12:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0fa739bf-48e6-4b6b-88ff-5e6eb7b64171 tempest-VolumesCloneTest-1975245463 None] Lock "cinder-43e9c59e-522d-4da0-81db-17ced94203b3-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Acquiring lock "cinder-b2aeca64-dbc8-4648-bf48-3727445f01d4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Lock "cinder-b2aeca64-dbc8-4648-bf48-3727445f01d4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Acquiring lock "cinder-quobyte-b2aeca64-dbc8-4648-bf48-3727445f01d4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-b2aeca64-dbc8-4648-bf48-3727445f01d4" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:00 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.info" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.info is being set with open permissions: ugo+rw Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f2b8de-4877-42b1-a164-c3f2e419e459]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.info Apr 15 10:13:00 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 Apr 15 10:13:00 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.info" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1213374574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979c8efd-c4ce-4679-9557-a213572e9c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f453a925c948b0bd35ac679abdae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:59Z,use_quota=True,user_id='351bff97a9524ea4a3928017f1447d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Creating volume 979c8efd-c4ce-4679-9557-a213572e9c96 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:00 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 1073741824 Apr 15 10:13:00 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f9da0152-abb1-4ba5-8e6f-c2232125edcc tempest-VolumesExtendTest-1221856876 None] Create snapshot completed successfully Apr 15 10:13:00 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4" returned: 0 in 0.527s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4 Apr 15 10:13:00 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b2aeca64-dbc8-4648-bf48-3727445f01d4" returned: 0 in 0.498s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Lock "cinder-quobyte-b2aeca64-dbc8-4648-bf48-3727445f01d4" released by "delete_volume" :: held 1.066s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:01 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 1073741824" returned: 0 in 0.569s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Created reservations ['0776b627-43b5-44e5-bed8-99a54c3e88f5', '1bee0d96-e76d-4b57-9952-a2b07567ff85', 'ee1f4e0e-978b-4922-a439-f931db5c81ee', '9f893bc3-9c6a-43d6-a669-547398bd60a8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:01 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 Apr 15 10:13:01 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:01 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:01 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:01 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96" returned: 0 in 0.491s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.179s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed082cf8-520a-4c57-b663-4aa0fcef9dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979c8efd-c4ce-4679-9557-a213572e9c96', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc91f87-0111-4c59-a1d1-4898083a534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce65d3-9640-4bc6-be6a-0ce5144008cd]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Volume volume-979c8efd-c4ce-4679-9557-a213572e9c96 (979c8efd-c4ce-4679-9557-a213572e9c96): created successfully Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc91f87-0111-4c59-a1d1-4898083a534e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Flow 'volume_create_manager' (d3e365c2-886f-488a-9d1d-2115662c72cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1f590890-19d0-445d-afda-634a108343b8 tempest-VolumeQuotasAdminTestJSON-42390675 None] Created volume successfully. Apr 15 10:13:01 devstack sudo[87157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac Apr 15 10:13:01 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.549s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Deleted volume successfully. Apr 15 10:13:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-71c41b76-d02a-41a4-876b-798c2253a5db tempest-VolumesCloneTest-1975245463 None] Lock "cinder-b2aeca64-dbc8-4648-bf48-3727445f01d4-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:02 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac" returned: 0 in 0.577s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 2G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 2G" returned: 0 in 0.094s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.717s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-59fe8bf3-d229-4dfc-88f9-c65a105c6902 tempest-VolumesExtendTest-1221856876 None] Extend volume completed successfully. Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Acquiring lock "cinder-979c8efd-c4ce-4679-9557-a213572e9c96-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "cinder-979c8efd-c4ce-4679-9557-a213572e9c96-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Acquiring lock "cinder-quobyte-979c8efd-c4ce-4679-9557-a213572e9c96" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "cinder-quobyte-979c8efd-c4ce-4679-9557-a213572e9c96" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "cinder-a00ff723-d914-4e84-a39c-87b8b1889db4-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab18b91-899f-45be-b28e-c75e64076139]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-a00ff723-d914-4e84-a39c-87b8b1889db4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "cinder-quobyte-2ab6186f-354b-45e1-a9e1-04bf4be919ac" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-2ab6186f-354b-45e1-a9e1-04bf4be919ac" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "cinder-quobyte-a00ff723-d914-4e84-a39c-87b8b1889db4" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-a00ff723-d914-4e84-a39c-87b8b1889db4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Deleting offline snapshot a00ff723-d914-4e84-a39c-87b8b1889db4 of volume 2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] snapshot_file for this snap is: volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:13:02 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 Apr 15 10:13:02 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3156d0-d244-4afe-ac35-3e2fbf932b40]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:02 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 Apr 15 10:13:02 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:03 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96" returned: 0 in 0.780s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:03 devstack sudo[87177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96 Apr 15 10:13:03 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:03 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4" returned: 0 in 0.720s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac24e559-4901-44a1-a73d-793823f58292]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:03 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac Apr 15 10:13:03 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-979c8efd-c4ce-4679-9557-a213572e9c96" returned: 0 in 0.618s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "cinder-quobyte-979c8efd-c4ce-4679-9557-a213572e9c96" released by "delete_volume" :: held 1.443s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Created reservations ['7733faee-d8ff-4551-88ea-249e8d73219d', '707515dd-014f-4735-841c-bb0a03c291e1', '49976944-377d-4c7a-b0f7-0a7b50130d22', '20e66500-f8d0-4f1f-a441-30d8795a216b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:04 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac" returned: 0 in 0.715s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 Apr 15 10:13:04 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Flow 'volume_create_manager' (36188969-7e8f-419b-be03-8cbe90901ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d282954-9202-47b8-938a-dce6c34a15e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d282954-9202-47b8-938a-dce6c34a15e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1945622168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4106628-2632-47ec-8bfe-8cd06773d1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0570308a241cba505c6decd373156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='4f92e6d75dd0439aa17622e31c310581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b12f826-5429-416c-8362-aa29b553dab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b12f826-5429-416c-8362-aa29b553dab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e1899-2bc2-42aa-92b7-8548926bd945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29e1899-2bc2-42aa-92b7-8548926bd945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4106628-2632-47ec-8bfe-8cd06773d1ec', 'volume_name': 'volume-e4106628-2632-47ec-8bfe-8cd06773d1ec', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfa6a0d-766e-4842-b0de-32a5486c6f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfa6a0d-766e-4842-b0de-32a5486c6f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e36ad6-dd44-49fc-a2f2-7279d91cb56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Volume e4106628-2632-47ec-8bfe-8cd06773d1ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4106628-2632-47ec-8bfe-8cd06773d1ec', 'volume_size': 2} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1945622168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4106628-2632-47ec-8bfe-8cd06773d1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0df0570308a241cba505c6decd373156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='4f92e6d75dd0439aa17622e31c310581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Creating volume e4106628-2632-47ec-8bfe-8cd06773d1ec {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec 2147483648 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec 2147483648 Apr 15 10:13:04 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.624s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Deleted volume successfully. Apr 15 10:13:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-01e339f5-951c-41e0-a687-22b14b0a67b3 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "cinder-979c8efd-c4ce-4679-9557-a213572e9c96-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:05 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4" returned: 0 in 0.719s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:05 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4 Apr 15 10:13:05 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Flow 'volume_create_manager' (6a306d4e-3efd-4472-bdc2-0177e0408067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d6749-c733-4926-b500-3f976758679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024d6749-c733-4926-b500-3f976758679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1192319582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc59f48-19e1-45ff-8209-51a0c5a83ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f453a925c948b0bd35ac679abdae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='351bff97a9524ea4a3928017f1447d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4171eba-4a04-427d-82d6-90394bc33338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4171eba-4a04-427d-82d6-90394bc33338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4574ef03-794e-45f9-90a7-9172f9695c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4574ef03-794e-45f9-90a7-9172f9695c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc59f48-19e1-45ff-8209-51a0c5a83ae8', 'volume_name': 'volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b74ec90-10be-445f-82b6-b4839d03d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b74ec90-10be-445f-82b6-b4839d03d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1028360c-4037-4da6-8d36-434bfcc41b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Volume efc59f48-19e1-45ff-8209-51a0c5a83ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8', 'volume_size': 1} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:05 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec 2147483648" returned: 0 in 0.785s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:05 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec Apr 15 10:13:05 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:05 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac.a00ff723-d914-4e84-a39c-87b8b1889db4" returned: 0 in 0.544s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-a00ff723-d914-4e84-a39c-87b8b1889db4" released by "_delete_snapshot" :: held 2.796s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-2ab6186f-354b-45e1-a9e1-04bf4be919ac" released by "delete_snapshot" :: held 2.822s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Created reservations ['5d948996-e582-4f26-9dc8-5b58f05322d3', '6d10187e-ddc6-4a6c-99eb-466ae8887fb0', '3520cf51-9efe-4230-bd36-fdd5d17fd7d2', '008f06c4-1bcb-48ee-b8c0-2e05479c9801'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Delete snapshot completed successfully. Apr 15 10:13:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d381d758-ae59-4182-be16-de71ed090885 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-a00ff723-d914-4e84-a39c-87b8b1889db4-delete_snapshot" released by "delete_snapshot" :: held 2.965s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "cinder-2ab6186f-354b-45e1-a9e1-04bf4be919ac-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-2ab6186f-354b-45e1-a9e1-04bf4be919ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "cinder-quobyte-2ab6186f-354b-45e1-a9e1-04bf4be919ac" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-2ab6186f-354b-45e1-a9e1-04bf4be919ac" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49dea24-4611-4518-9fba-734b2fb05bf9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:06 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec" returned: 0 in 0.619s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1192319582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc59f48-19e1-45ff-8209-51a0c5a83ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f453a925c948b0bd35ac679abdae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:05Z,use_quota=True,user_id='351bff97a9524ea4a3928017f1447d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Creating volume efc59f48-19e1-45ff-8209-51a0c5a83ae8 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:06 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e36ad6-dd44-49fc-a2f2-7279d91cb56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4106628-2632-47ec-8bfe-8cd06773d1ec', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd497ffc-40c7-44f5-936f-13637d9f0921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:06 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 1073741824 Apr 15 10:13:06 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:06 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac Apr 15 10:13:06 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:06 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Volume volume-e4106628-2632-47ec-8bfe-8cd06773d1ec (e4106628-2632-47ec-8bfe-8cd06773d1ec): created successfully Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd497ffc-40c7-44f5-936f-13637d9f0921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Flow 'volume_create_manager' (36188969-7e8f-419b-be03-8cbe90901ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-91c6286c-44cb-466f-8d2d-92de74bc38ef tempest-VolumesCloneNegativeTest-216417996 None] Created volume successfully. Apr 15 10:13:06 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac" returned: 0 in 0.603s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:06 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac Apr 15 10:13:06 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:06 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 1073741824" returned: 0 in 0.656s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:06 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 Apr 15 10:13:06 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Acquiring lock "cinder-e4106628-2632-47ec-8bfe-8cd06773d1ec-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Lock "cinder-e4106628-2632-47ec-8bfe-8cd06773d1ec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Acquiring lock "cinder-quobyte-e4106628-2632-47ec-8bfe-8cd06773d1ec" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Lock "cinder-quobyte-e4106628-2632-47ec-8bfe-8cd06773d1ec" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[211e4438-9fa2-4cbb-b0b3-af48b0fc871b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:07 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec Apr 15 10:13:07 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:07 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2ab6186f-354b-45e1-a9e1-04bf4be919ac" returned: 0 in 0.732s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-quobyte-2ab6186f-354b-45e1-a9e1-04bf4be919ac" released by "delete_volume" :: held 1.370s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Created reservations ['863f729e-0ef7-4fe1-b4a7-05afc831b12a', '1018ea75-f850-4b1c-a1bd-f331bb1d2d9a', '7c26dea3-2a5d-4142-81b3-86ff673491df', 'aadaa526-9265-4c04-b455-99acaaf369a5'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:07 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8" returned: 0 in 0.711s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1028360c-4037-4da6-8d36-434bfcc41b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3397f9d9-e0df-4471-9127-d4867a0cba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Volume volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 (efc59f48-19e1-45ff-8209-51a0c5a83ae8): created successfully Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3397f9d9-e0df-4471-9127-d4867a0cba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Flow 'volume_create_manager' (6a306d4e-3efd-4472-bdc2-0177e0408067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-df1b3a50-4a85-480d-bfe9-8c4db9ba9e06 tempest-VolumeQuotasAdminTestJSON-42390675 None] Created volume successfully. Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:07 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:07 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:07 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec" returned: 0 in 0.589s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:07 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec Apr 15 10:13:07 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:08 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.495s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Deleted volume successfully. Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fac7f369-e820-4fab-a26d-8bccd6d702e2 tempest-VolumesExtendTest-1221856876 None] Lock "cinder-2ab6186f-354b-45e1-a9e1-04bf4be919ac-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:08 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e4106628-2632-47ec-8bfe-8cd06773d1ec" returned: 0 in 0.538s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Lock "cinder-quobyte-e4106628-2632-47ec-8bfe-8cd06773d1ec" released by "delete_volume" :: held 1.154s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Created reservations ['034c74da-891e-4b86-92e5-94e46d63b69a', 'ce635f38-5fb2-4682-bb73-e4afe3c110e0', 'f5b56191-e2a6-4a12-b306-4201c9ed88d5', '752e7c9b-8b65-4ee8-89ad-898c51a6de03'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:08 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:08 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:09 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.652s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:09 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Deleted volume successfully. Apr 15 10:13:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-19936f9f-e3f9-4d36-aecd-7e870dbd6750 tempest-VolumesCloneNegativeTest-216417996 None] Lock "cinder-e4106628-2632-47ec-8bfe-8cd06773d1ec-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6d4e8d16-c2d3-4ff5-b909-4a89fc80ebea tempest-VolumeQuotasAdminTestJSON-779245850 None] Transfer volume completed successfully. Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Acquiring lock "cinder-efc59f48-19e1-45ff-8209-51a0c5a83ae8-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Lock "cinder-efc59f48-19e1-45ff-8209-51a0c5a83ae8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Acquiring lock "cinder-quobyte-efc59f48-19e1-45ff-8209-51a0c5a83ae8" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Lock "cinder-quobyte-efc59f48-19e1-45ff-8209-51a0c5a83ae8" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb2448-d382-4b3e-9230-1f7d0e0987b7]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:10 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 Apr 15 10:13:10 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (ff2475e8-91a4-413b-b2c8-1be4e58a99c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9abc06d-18d4-4e81-aeb8-d8d6e5eac2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9abc06d-18d4-4e81-aeb8-d8d6e5eac2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-169702245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b50c530-8a01-4ff2-8269-38bd96c80fb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:11Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e13eea-f1dc-4703-b914-5eb855ba1a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e13eea-f1dc-4703-b914-5eb855ba1a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e30899-1845-4ed7-9d9c-98aabe62d284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:10 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e30899-1845-4ed7-9d9c-98aabe62d284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b50c530-8a01-4ff2-8269-38bd96c80fb4', 'volume_name': 'volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac6fe60-fe0d-44b0-b175-80077b53197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac6fe60-fe0d-44b0-b175-80077b53197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8b1dec-c500-4a49-82d4-3b016dfed7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Volume 9b50c530-8a01-4ff2-8269-38bd96c80fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4', 'volume_size': 1} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-169702245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b50c530-8a01-4ff2-8269-38bd96c80fb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:11Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Creating volume 9b50c530-8a01-4ff2-8269-38bd96c80fb4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:10 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8" returned: 0 in 0.796s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:10 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 1073741824 Apr 15 10:13:10 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:10 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8 Apr 15 10:13:10 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:11 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-efc59f48-19e1-45ff-8209-51a0c5a83ae8" returned: 0 in 0.637s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Lock "cinder-quobyte-efc59f48-19e1-45ff-8209-51a0c5a83ae8" released by "delete_volume" :: held 1.466s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Created reservations ['d70a528c-42bf-4c6b-9581-d5a25cf0e046', '02e55ed7-050e-4d7a-8997-d9fdec7cad46', '16396ab6-023c-4b79-82ae-7c3137229920', 'a05cf35b-f80b-49c0-92a1-e4a88109920e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:11 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 1073741824" returned: 0 in 0.757s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:11 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:11 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:11 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 Apr 15 10:13:11 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (5e795141-3838-409d-a7ac-5ab16b96ab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc24d78b-511d-485e-8ab5-ecb6efeadeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc24d78b-511d-485e-8ab5-ecb6efeadeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-639696813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa47a68-004e-47cf-868b-3c710862adc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca1ef74bcfa4233820355e50a919e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:12Z,use_quota=True,user_id='9dbb358a2b39452194c8733fe813ddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4aedf2-e7c1-43f1-80fc-39ef15937e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4aedf2-e7c1-43f1-80fc-39ef15937e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87a56a6-460a-4ea3-90cf-22d56ac84e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87a56a6-460a-4ea3-90cf-22d56ac84e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa47a68-004e-47cf-868b-3c710862adc4', 'volume_name': 'volume-caa47a68-004e-47cf-868b-3c710862adc4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba9bac7-e478-49d6-940d-77676d54117f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba9bac7-e478-49d6-940d-77676d54117f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ca670-2fb0-4cfa-a7e4-9592d86426a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Volume caa47a68-004e-47cf-868b-3c710862adc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa47a68-004e-47cf-868b-3c710862adc4', 'volume_size': 1} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:12 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4" returned: 0 in 0.572s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-639696813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa47a68-004e-47cf-868b-3c710862adc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca1ef74bcfa4233820355e50a919e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:12Z,use_quota=True,user_id='9dbb358a2b39452194c8733fe813ddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Creating volume caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:12 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8b1dec-c500-4a49-82d4-3b016dfed7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 1073741824 Apr 15 10:13:12 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2516dfe7-fec7-4974-a3f5-093680f25a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:12 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Volume volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 (9b50c530-8a01-4ff2-8269-38bd96c80fb4): created successfully Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2516dfe7-fec7-4974-a3f5-093680f25a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (ff2475e8-91a4-413b-b2c8-1be4e58a99c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-81db3b71-44ca-4c64-af34-74af1c6f195b tempest-VolumesGetTest-300345946 None] Created volume successfully. Apr 15 10:13:12 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.752s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Deleted volume successfully. Apr 15 10:13:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cbf38a1c-3d21-4502-a9af-54bd1f35f070 tempest-VolumeQuotasAdminTestJSON-1368708560 None] Lock "cinder-efc59f48-19e1-45ff-8209-51a0c5a83ae8-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:13 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 1073741824" returned: 0 in 0.807s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:13 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 Apr 15 10:13:13 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (677c3a21-5442-4aa9-ba08-571085aaf39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3822351c-1bb3-4545-9174-249ce0ae69b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3822351c-1bb3-4545-9174-249ce0ae69b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1683512157',display_name='tempest-VolumesGetTest-Volume-964071584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bfd9a3-86d7-45a4-98ba-54c17ddc944b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:14Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d85a5f-934c-4f5d-ad30-5e45c481bf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d85a5f-934c-4f5d-ad30-5e45c481bf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b94e88d-c02c-41eb-99ab-da591de6f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b94e88d-c02c-41eb-99ab-da591de6f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bfd9a3-86d7-45a4-98ba-54c17ddc944b', 'volume_name': 'volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c697150-accc-4e59-aee8-c316ea91742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c697150-accc-4e59-aee8-c316ea91742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa5d3ef-290e-4b1b-8991-ffc3a91c77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Volume 60bfd9a3-86d7-45a4-98ba-54c17ddc944b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b', 'volume_size': 1} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:13 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4" returned: 0 in 0.717s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1683512157',display_name='tempest-VolumesGetTest-Volume-964071584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bfd9a3-86d7-45a4-98ba-54c17ddc944b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:14Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Creating volume 60bfd9a3-86d7-45a4-98ba-54c17ddc944b {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:13 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:13 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b 1073741824 Apr 15 10:13:13 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5ca670-2fb0-4cfa-a7e4-9592d86426a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa47a68-004e-47cf-868b-3c710862adc4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130a7fb2-2998-449b-803d-26bc835340f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Volume volume-caa47a68-004e-47cf-868b-3c710862adc4 (caa47a68-004e-47cf-868b-3c710862adc4): created successfully Apr 15 10:13:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130a7fb2-2998-449b-803d-26bc835340f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (5e795141-3838-409d-a7ac-5ab16b96ab48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-025e0276-c457-41d0-a56c-d9d935c33968 tempest-VolumeDependencyTests-545440044 None] Created volume successfully. Apr 15 10:13:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:14 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b 1073741824" returned: 0 in 0.896s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:14 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b Apr 15 10:13:14 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b" returned: 0 in 0.757s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.943s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Creating offline snapshot 53cfdc03-8857-4aef-8da8-a96b2c2e9533 of volume caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa5d3ef-290e-4b1b-8991-ffc3a91c77d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc488b5-b01c-4217-9e27-ac519d7b63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59151f3-db32-41c6-9813-ab14d6f37118]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:15 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 Apr 15 10:13:15 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Volume volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b (60bfd9a3-86d7-45a4-98ba-54c17ddc944b): created successfully Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc488b5-b01c-4217-9e27-ac519d7b63f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (677c3a21-5442-4aa9-ba08-571085aaf39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-31ef512b-3dc3-4fb5-869f-d3acb7aeb818 tempest-VolumesGetTest-300345946 None] Created volume successfully. Apr 15 10:13:16 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4" returned: 0 in 0.765s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:16 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 1G Apr 15 10:13:16 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-60bfd9a3-86d7-45a4-98ba-54c17ddc944b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Lock "cinder-60bfd9a3-86d7-45a4-98ba-54c17ddc944b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-60bfd9a3-86d7-45a4-98ba-54c17ddc944b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-60bfd9a3-86d7-45a4-98ba-54c17ddc944b" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:17 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9e8734-2f92-4937-b2f5-50b9376cb835]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 1G" returned: 0 in 0.848s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caa47a68-004e-47cf-868b-3c710862adc4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:17 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caa47a68-004e-47cf-868b-3c710862adc4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 Apr 15 10:13:17 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:17 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b Apr 15 10:13:17 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:17 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caa47a68-004e-47cf-868b-3c710862adc4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533" returned: 0 in 0.642s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:17 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 is being set with open permissions: ugo+rw Apr 15 10:13:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:17 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 Apr 15 10:13:17 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:18 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b" returned: 0 in 0.825s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:18 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b Apr 15 10:13:18 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:18 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533" returned: 0 in 0.661s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:18 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.info Apr 15 10:13:18 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:18 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-60bfd9a3-86d7-45a4-98ba-54c17ddc944b" returned: 0 in 0.598s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-60bfd9a3-86d7-45a4-98ba-54c17ddc944b" released by "delete_volume" :: held 1.487s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Created reservations ['125ab495-b6b6-4355-b8ba-2ead9c6927df', 'ad8cbc5e-4ef1-4b5d-a44a-f4b9f5fdd7db', 'eff0a1cd-a45a-499b-81cf-5b4975e9d071', '7afd23b8-8d30-4137-9a91-7c4c255dbba0'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:18 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:18 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:19 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.info" returned: 0 in 0.602s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:19 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.info is being set with open permissions: ugo+rw Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:19 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.info Apr 15 10:13:19 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:19 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.472s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Deleted volume successfully. Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0af9f62b-6095-4762-b245-1c7db038f22b tempest-VolumesGetTest-300345946 None] Lock "cinder-60bfd9a3-86d7-45a4-98ba-54c17ddc944b-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-9b50c530-8a01-4ff2-8269-38bd96c80fb4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Lock "cinder-9b50c530-8a01-4ff2-8269-38bd96c80fb4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-9b50c530-8a01-4ff2-8269-38bd96c80fb4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-9b50c530-8a01-4ff2-8269-38bd96c80fb4" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7232f-6835-456c-96fc-4dc1b1b8d7a4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:19 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 Apr 15 10:13:19 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:19 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.info" returned: 0 in 0.655s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.263s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-82d879db-7612-4a1c-b232-772ae6394f8b tempest-VolumeDependencyTests-545440044 None] Create snapshot completed successfully Apr 15 10:13:20 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4" returned: 0 in 0.571s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:20 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4 Apr 15 10:13:20 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:20 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b50c530-8a01-4ff2-8269-38bd96c80fb4" returned: 0 in 0.605s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-9b50c530-8a01-4ff2-8269-38bd96c80fb4" released by "delete_volume" :: held 1.210s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Created reservations ['1404b253-717b-4bc0-9920-c1644857f168', 'f9209e53-f142-4986-927b-cbf783ed35c3', '8e48c27e-b435-4b6b-959a-e95af74928cd', 'ff47b031-ed82-43d4-b9f5-bbd76f629a0c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:20 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:20 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (e0fa97ee-3da4-48bc-95d5-7fba02adba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669ac8d8-6c60-4070-a641-dae237de7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669ac8d8-6c60-4070-a641-dae237de7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2145647873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb1856f-2558-4dbb-a825-a02cf529692a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca1ef74bcfa4233820355e50a919e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53cfdc03-8857-4aef-8da8-a96b2c2e9533,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:21Z,use_quota=True,user_id='9dbb358a2b39452194c8733fe813ddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73108666-8f96-4078-be8f-0b43c7fecbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73108666-8f96-4078-be8f-0b43c7fecbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958bcbbb-c929-4256-b20b-e5203c952481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958bcbbb-c929-4256-b20b-e5203c952481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abb1856f-2558-4dbb-a825-a02cf529692a', 'volume_name': 'volume-abb1856f-2558-4dbb-a825-a02cf529692a', 'volume_size': 1, 'snapshot_id': '53cfdc03-8857-4aef-8da8-a96b2c2e9533'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e1d056-dca3-4e28-82a8-da1e8212becd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e1d056-dca3-4e28-82a8-da1e8212becd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e061388-0803-484b-a39f-e7d6aa100382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Volume abb1856f-2558-4dbb-a825-a02cf529692a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abb1856f-2558-4dbb-a825-a02cf529692a', 'volume_size': 1, 'snapshot_id': '53cfdc03-8857-4aef-8da8-a96b2c2e9533'} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-53cfdc03-8857-4aef-8da8-a96b2c2e9533-abb1856f-2558-4dbb-a825-a02cf529692a" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-53cfdc03-8857-4aef-8da8-a96b2c2e9533-abb1856f-2558-4dbb-a825-a02cf529692a" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Creating volume abb1856f-2558-4dbb-a825-a02cf529692a from snapshot 53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-abb1856f-2558-4dbb-a825-a02cf529692a" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-abb1856f-2558-4dbb-a825-a02cf529692a" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] snapshot: 53cfdc03-8857-4aef-8da8-a96b2c2e9533, volume: abb1856f-2558-4dbb-a825-a02cf529692a, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5a74f0-32aa-48b9-a0f8-81e976481057]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:21 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 Apr 15 10:13:21 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:21 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.783s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Deleted volume successfully. Apr 15 10:13:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-147390a1-0eb5-44ae-b6ee-18ef67cb6c7b tempest-VolumesGetTest-300345946 None] Lock "cinder-9b50c530-8a01-4ff2-8269-38bd96c80fb4-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (e6eb309a-947c-4938-b9c6-88f0a1fa655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f686c5-f97f-4d7b-84f9-15770d74926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f686c5-f97f-4d7b-84f9-15770d74926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2138829568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41baa2c-0348-4a61-87c6-de948c6dcda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:22Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32435634-5d0b-4610-ae49-b778d6d8f405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32435634-5d0b-4610-ae49-b778d6d8f405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4ad7b1-80d3-4f4c-9f05-22b7b77057bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4ad7b1-80d3-4f4c-9f05-22b7b77057bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41baa2c-0348-4a61-87c6-de948c6dcda7', 'volume_name': 'volume-e41baa2c-0348-4a61-87c6-de948c6dcda7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768a3aef-1c5f-4cb3-b624-ea7e9bcd2a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768a3aef-1c5f-4cb3-b624-ea7e9bcd2a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6742e86-3537-41f4-8a13-b8eec82758aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Volume e41baa2c-0348-4a61-87c6-de948c6dcda7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41baa2c-0348-4a61-87c6-de948c6dcda7', 'volume_size': 1} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:22 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533" returned: 0 in 0.767s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caa47a68-004e-47cf-868b-3c710862adc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb71962b-714c-483a-856b-557896c94593]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:22 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 Apr 15 10:13:22 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:22 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4" returned: 0 in 0.608s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:13:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:23 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a Apr 15 10:13:23 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:25 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a" returned: 0 in 2.908s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[62417076-146b-4dc1-bce0-b7300c211477]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:25 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 Apr 15 10:13:25 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:26 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4" returned: 0 in 0.846s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:26 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4, size 1024.00 MB, duration 2.91 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:26 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Converted 1024.00 MB image at 351.77 MB/s Apr 15 10:13:26 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a is being set with open permissions: ugo+rw Apr 15 10:13:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:26 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a Apr 15 10:13:26 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:27 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a" returned: 0 in 0.711s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-abb1856f-2558-4dbb-a825-a02cf529692a" released by "_copy_volume_from_snapshot" :: held 5.936s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-53cfdc03-8857-4aef-8da8-a96b2c2e9533-abb1856f-2558-4dbb-a825-a02cf529692a" released by "_create_volume_from_snapshot" :: held 5.957s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.968s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.212s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2138829568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41baa2c-0348-4a61-87c6-de948c6dcda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:22Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Creating volume e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:27 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:27 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 1073741824 Apr 15 10:13:27 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e061388-0803-484b-a39f-e7d6aa100382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb1856f-2558-4dbb-a825-a02cf529692a', 'volume_size': 1, 'snapshot_id': '53cfdc03-8857-4aef-8da8-a96b2c2e9533'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdf3113-b5d7-447c-9eff-50399f8dc0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Volume volume-abb1856f-2558-4dbb-a825-a02cf529692a (abb1856f-2558-4dbb-a825-a02cf529692a): created successfully Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdf3113-b5d7-447c-9eff-50399f8dc0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (e0fa97ee-3da4-48bc-95d5-7fba02adba98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fcdc78cc-021f-4630-be69-faf5dff2e25b tempest-VolumeDependencyTests-545440044 None] Created volume successfully. Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-53cfdc03-8857-4aef-8da8-a96b2c2e9533-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-53cfdc03-8857-4aef-8da8-a96b2c2e9533-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-caa47a68-004e-47cf-868b-3c710862adc4" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-caa47a68-004e-47cf-868b-3c710862adc4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-53cfdc03-8857-4aef-8da8-a96b2c2e9533" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-53cfdc03-8857-4aef-8da8-a96b2c2e9533" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Deleting offline snapshot 53cfdc03-8857-4aef-8da8-a96b2c2e9533 of volume caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:13:28 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] snapshot_file for this snap is: volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 1073741824" returned: 0 in 0.697s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd046b-c63b-4c33-a00b-acde9f53fdc9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:28 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 Apr 15 10:13:28 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:28 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 Apr 15 10:13:28 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:28 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533" returned: 0 in 0.713s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caa47a68-004e-47cf-868b-3c710862adc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b247d37d-338c-465e-a256-ca3b8006e3ab]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:29 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7" returned: 0 in 0.763s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6742e86-3537-41f4-8a13-b8eec82758aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41baa2c-0348-4a61-87c6-de948c6dcda7', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b201fbe-1ce8-484b-81a2-731400549027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Volume volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 (e41baa2c-0348-4a61-87c6-de948c6dcda7): created successfully Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b201fbe-1ce8-484b-81a2-731400549027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (e6eb309a-947c-4938-b9c6-88f0a1fa655a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-eae81555-7d7e-4710-8ae9-b407c874ae07 tempest-VolumesGetTest-300345946 None] Created volume successfully. Apr 15 10:13:29 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 Apr 15 10:13:29 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:29 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4" returned: 0 in 0.711s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:29 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 Apr 15 10:13:29 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (18a09584-a8a2-4a91-b840-57a7a82d2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08b1c57-4954-4d2a-95fa-4a00a3396a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08b1c57-4954-4d2a-95fa-4a00a3396a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1109290991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f5252ac-24a5-49a7-838c-4d41ef1adc7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e41baa2c-0348-4a61-87c6-de948c6dcda7,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:30Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f34528e-c9cd-4b76-8047-017afb3f0047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f34528e-c9cd-4b76-8047-017afb3f0047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe33b3c0-f862-457c-9c21-4dbe4bfbe53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe33b3c0-f862-457c-9c21-4dbe4bfbe53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9f5252ac-24a5-49a7-838c-4d41ef1adc7b', 'volume_name': 'volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b', 'volume_size': 1, 'source_volid': 'e41baa2c-0348-4a61-87c6-de948c6dcda7', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b861b55f-10fb-4828-948b-ec39ba40511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b861b55f-10fb-4828-948b-ec39ba40511b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6e6c1b-1248-45e2-96ee-e00943beb36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:30 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Volume 9f5252ac-24a5-49a7-838c-4d41ef1adc7b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b', 'volume_size': 1, 'source_volid': 'e41baa2c-0348-4a61-87c6-de948c6dcda7', 'source_volstatus': 'available'} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:30 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Cloning volume e41baa2c-0348-4a61-87c6-de948c6dcda7 to volume 9f5252ac-24a5-49a7-838c-4d41ef1adc7b Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Creating offline snapshot 29ea3478-f2ff-4538-a12a-496aeb0959fb of volume e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8bf570-3ea8-4abb-94f1-822aac7f9c42]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:30 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533" returned: 0 in 0.659s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:30 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 Apr 15 10:13:30 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:30 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533 Apr 15 10:13:30 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:30 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4.53cfdc03-8857-4aef-8da8-a96b2c2e9533" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-53cfdc03-8857-4aef-8da8-a96b2c2e9533" released by "_delete_snapshot" :: held 2.727s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-caa47a68-004e-47cf-868b-3c710862adc4" released by "delete_snapshot" :: held 2.770s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:30 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7" returned: 0 in 0.642s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:30 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb 1G Apr 15 10:13:30 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:30 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Created reservations ['7f8063b0-b315-4997-8c0c-7b129cbf4671', '2e2b1873-97f1-41e0-8475-ae9ee20c4525', 'b02e159b-f109-4124-9a7a-285194dbb8c1', '8ec746d2-dc08-4a15-8e19-2c838691c7bf'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Delete snapshot completed successfully. Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b97f1bb-eb8c-483e-89da-165df331a5b4 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-53cfdc03-8857-4aef-8da8-a96b2c2e9533-delete_snapshot" released by "delete_snapshot" :: held 2.958s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-caa47a68-004e-47cf-868b-3c710862adc4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-caa47a68-004e-47cf-868b-3c710862adc4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-caa47a68-004e-47cf-868b-3c710862adc4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-caa47a68-004e-47cf-868b-3c710862adc4" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3683ef6c-befa-4186-85a1-d49e6153aa53]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Flow 'volume_create_manager' (d7c94f47-fbf9-43fd-8ad5-5620dd3fed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e700a36e-7070-4a61-aca3-33778aeaf9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:31 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 Apr 15 10:13:31 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e700a36e-7070-4a61-aca3-33778aeaf9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-611570604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c45e950-cf42-46fa-b49d-4aebff18becf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4348de0027eb4c899bc1a60d87e846a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:31Z,use_quota=True,user_id='fe550e8af1794e368d566be5b24d01c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2a0b19-2c4f-4351-ba30-a2c62126a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2a0b19-2c4f-4351-ba30-a2c62126a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e914e49-7988-438c-a612-e059b26e1d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e914e49-7988-438c-a612-e059b26e1d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c45e950-cf42-46fa-b49d-4aebff18becf', 'volume_name': 'volume-2c45e950-cf42-46fa-b49d-4aebff18becf', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b515d10-6852-48eb-ba6b-0bb4b9dc516a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b515d10-6852-48eb-ba6b-0bb4b9dc516a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2e1208-6e6f-45c5-9056-5b61e89bb307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:31 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Volume 2c45e950-cf42-46fa-b49d-4aebff18becf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c45e950-cf42-46fa-b49d-4aebff18becf', 'volume_size': 1} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:31 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb 1G" returned: 0 in 0.800s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:31 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb Apr 15 10:13:31 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:32 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4" returned: 0 in 0.605s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:32 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4 Apr 15 10:13:32 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:32 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb" returned: 0 in 0.608s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:32 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb is being set with open permissions: ugo+rw Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:32 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb Apr 15 10:13:32 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:32 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-caa47a68-004e-47cf-868b-3c710862adc4" returned: 0 in 0.728s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-caa47a68-004e-47cf-868b-3c710862adc4" released by "delete_volume" :: held 1.400s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Created reservations ['98ef51bd-fc3c-410f-aec5-32fb162e7e77', '126bff16-c5e3-41cd-a817-67dfe4f49cd4', '2cf18e54-4982-46e0-951b-b78bf636c20b', '2e8f4a94-35f7-4818-997c-0543a1546f26'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:33 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:33 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:33 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb" returned: 0 in 0.734s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:33 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.info Apr 15 10:13:33 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:33 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:33 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:33 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.info" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:33 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.info is being set with open permissions: ugo+rw Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:33 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.info Apr 15 10:13:33 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:33 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.606s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Deleted volume successfully. Apr 15 10:13:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9caddbcb-0ad4-4005-9189-00820c2262d0 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-caa47a68-004e-47cf-868b-3c710862adc4-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:34 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (cf07826e-ea63-4e1a-8234-0309169a68b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f949f46-1b59-422f-91e2-4e5bda30ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.723s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f949f46-1b59-422f-91e2-4e5bda30ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1489056311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281fb517-aedb-4c15-ace3-00f916ddbc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca1ef74bcfa4233820355e50a919e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:34Z,use_quota=True,user_id='9dbb358a2b39452194c8733fe813ddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0087154-3aeb-4f89-985b-8209c36de3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0087154-3aeb-4f89-985b-8209c36de3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fed305-b0b9-4a01-8906-046a223cc9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fed305-b0b9-4a01-8906-046a223cc9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281fb517-aedb-4c15-ace3-00f916ddbc02', 'volume_name': 'volume-281fb517-aedb-4c15-ace3-00f916ddbc02', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fd0d53-f02c-4a61-8e59-42818aaf2ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fd0d53-f02c-4a61-8e59-42818aaf2ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a074f844-a5f3-4fe5-a8ea-7dc9be1e4089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:34 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Volume 281fb517-aedb-4c15-ace3-00f916ddbc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281fb517-aedb-4c15-ace3-00f916ddbc02', 'volume_size': 1} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:34 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.info" returned: 0 in 0.591s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] snapshot: 29ea3478-f2ff-4538-a12a-496aeb0959fb, volume: 9f5252ac-24a5-49a7-838c-4d41ef1adc7b, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0371aa8b-1d88-431f-85df-6f4e57da2d5d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:34 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb Apr 15 10:13:34 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:34 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb" returned: 0 in 0.634s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41baa2c-0348-4a61-87c6-de948c6dcda7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcd076e-f220-499a-ae27-d784c99ff0e2]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:35 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 Apr 15 10:13:35 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:35 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:35 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:13:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:35 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b Apr 15 10:13:35 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:38 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" returned: 0 in 3.498s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[530f2255-009a-482e-87a9-7dcb8bd8e44d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:39 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 Apr 15 10:13:39 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:39 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7" returned: 0 in 0.669s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:39 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7, size 1024.00 MB, duration 3.50 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:39 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Converted 1024.00 MB image at 292.65 MB/s Apr 15 10:13:39 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b is being set with open permissions: ugo+rw Apr 15 10:13:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:39 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b Apr 15 10:13:39 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:40 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" returned: 0 in 0.537s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" released by "_copy_volume_from_snapshot" :: held 5.968s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-29ea3478-f2ff-4538-a12a-496aeb0959fb" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-29ea3478-f2ff-4538-a12a-496aeb0959fb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Deleting offline snapshot 29ea3478-f2ff-4538-a12a-496aeb0959fb of volume e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] snapshot_file for this snap is: volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e90152-6019-4ee7-b062-d953de95c71b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:40 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb Apr 15 10:13:40 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:40 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb" returned: 0 in 0.555s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41baa2c-0348-4a61-87c6-de948c6dcda7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52835bbc-6c60-4412-92ce-560378fabc8a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:40 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 Apr 15 10:13:40 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:41 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7" returned: 0 in 0.563s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:41 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb Apr 15 10:13:41 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:42 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb" returned: 0 in 0.721s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:42 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb Apr 15 10:13:42 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:42 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7.29ea3478-f2ff-4538-a12a-496aeb0959fb" returned: 0 in 0.590s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-29ea3478-f2ff-4538-a12a-496aeb0959fb" released by "_delete_snapshot" :: held 2.500s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.555s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.188s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-611570604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c45e950-cf42-46fa-b49d-4aebff18becf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4348de0027eb4c899bc1a60d87e846a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:31Z,use_quota=True,user_id='fe550e8af1794e368d566be5b24d01c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Creating volume 2c45e950-cf42-46fa-b49d-4aebff18becf {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:42 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba6e6c1b-1248-45e2-96ee-e00943beb36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b', 'volume_size': 1, 'source_volid': 'e41baa2c-0348-4a61-87c6-de948c6dcda7', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:42 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf 1073741824 Apr 15 10:13:42 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c273c817-a835-4a1f-b8b7-b6477ff50e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:42 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Volume volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b (9f5252ac-24a5-49a7-838c-4d41ef1adc7b): created successfully Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c273c817-a835-4a1f-b8b7-b6477ff50e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (18a09584-a8a2-4a91-b840-57a7a82d2d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2ccb8285-6f20-44b3-9b78-4694d94b4941 tempest-VolumesGetTest-300345946 None] Created volume successfully. Apr 15 10:13:43 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf 1073741824" returned: 0 in 0.564s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:43 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf Apr 15 10:13:43 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (7b30e2a3-506c-42e2-907f-d2cb260a3546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63131649-5003-4126-b91a-3628a1bb242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63131649-5003-4126-b91a-3628a1bb242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573212365',display_name='tempest-VolumesGetTest-Volume-2125868720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf13aa1a-4288-4b44-b252-c659cc0e1285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:44Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758037f9-6be6-435f-8ffb-0caa047c76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758037f9-6be6-435f-8ffb-0caa047c76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f48194-1083-459a-88e7-8a6816762770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f48194-1083-459a-88e7-8a6816762770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf13aa1a-4288-4b44-b252-c659cc0e1285', 'volume_name': 'volume-bf13aa1a-4288-4b44-b252-c659cc0e1285', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6559f4-508e-41f4-b7f9-b9836b4c41a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6559f4-508e-41f4-b7f9-b9836b4c41a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f25edb-6332-46c0-bfb2-6314d763a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Volume bf13aa1a-4288-4b44-b252-c659cc0e1285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf13aa1a-4288-4b44-b252-c659cc0e1285', 'volume_size': 1} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:43 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf" returned: 0 in 0.529s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.781s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1489056311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281fb517-aedb-4c15-ace3-00f916ddbc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca1ef74bcfa4233820355e50a919e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:34Z,use_quota=True,user_id='9dbb358a2b39452194c8733fe813ddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Creating volume 281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:43 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2e1208-6e6f-45c5-9056-5b61e89bb307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c45e950-cf42-46fa-b49d-4aebff18becf', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:43 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 1073741824 Apr 15 10:13:43 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb373208-b4ef-4e55-a6fc-af7d97ed02b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Volume volume-2c45e950-cf42-46fa-b49d-4aebff18becf (2c45e950-cf42-46fa-b49d-4aebff18becf): created successfully Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb373208-b4ef-4e55-a6fc-af7d97ed02b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Flow 'volume_create_manager' (d7c94f47-fbf9-43fd-8ad5-5620dd3fed65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1882fa45-5fab-4f58-8f77-468e5ca04894 tempest-AbsoluteLimitsTests-755293950 None] Created volume successfully. Apr 15 10:13:44 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 1073741824" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:44 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 Apr 15 10:13:44 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Acquiring lock "cinder-2c45e950-cf42-46fa-b49d-4aebff18becf-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Lock "cinder-2c45e950-cf42-46fa-b49d-4aebff18becf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Acquiring lock "cinder-quobyte-2c45e950-cf42-46fa-b49d-4aebff18becf" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Lock "cinder-quobyte-2c45e950-cf42-46fa-b49d-4aebff18becf" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162d5de-2521-4b12-a5cb-c2d3c57142bb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:45 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf Apr 15 10:13:45 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:45 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02" returned: 0 in 0.538s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573212365',display_name='tempest-VolumesGetTest-Volume-2125868720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf13aa1a-4288-4b44-b252-c659cc0e1285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:44Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Creating volume bf13aa1a-4288-4b44-b252-c659cc0e1285 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:45 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a074f844-a5f3-4fe5-a8ea-7dc9be1e4089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281fb517-aedb-4c15-ace3-00f916ddbc02', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a7243d-3bdb-4436-972f-f38cd1592b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:45 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 1073741824 Apr 15 10:13:45 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Volume volume-281fb517-aedb-4c15-ace3-00f916ddbc02 (281fb517-aedb-4c15-ace3-00f916ddbc02): created successfully Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a7243d-3bdb-4436-972f-f38cd1592b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (cf07826e-ea63-4e1a-8234-0309169a68b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-22fd10aa-98d9-455f-b836-a2f871af88a0 tempest-VolumeDependencyTests-545440044 None] Created volume successfully. Apr 15 10:13:45 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf" returned: 0 in 0.653s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:45 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf Apr 15 10:13:45 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:45 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 1073741824" returned: 0 in 0.582s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:45 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 Apr 15 10:13:45 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (1f059679-8dc0-4545-9138-f2d9a0a30c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e818093-9e96-4445-a871-7653f840b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e818093-9e96-4445-a871-7653f840b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2020257311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02ae3537-b0af-40a2-8238-5d0edbf1b7a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca1ef74bcfa4233820355e50a919e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=281fb517-aedb-4c15-ace3-00f916ddbc02,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:46Z,use_quota=True,user_id='9dbb358a2b39452194c8733fe813ddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b79dc00-891c-4e45-8d2e-6fb41a638dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b79dc00-891c-4e45-8d2e-6fb41a638dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a929540-b91d-434e-977f-18632986a61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a929540-b91d-434e-977f-18632986a61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '02ae3537-b0af-40a2-8238-5d0edbf1b7a3', 'volume_name': 'volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3', 'volume_size': 1, 'source_volid': '281fb517-aedb-4c15-ace3-00f916ddbc02', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5078f69-ad0b-4da6-ba3c-85c664dd46b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5078f69-ad0b-4da6-ba3c-85c664dd46b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf9ae00-8c94-4344-a39b-16d5263e1989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Volume 02ae3537-b0af-40a2-8238-5d0edbf1b7a3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3', 'volume_size': 1, 'source_volid': '281fb517-aedb-4c15-ace3-00f916ddbc02', 'source_volstatus': 'available'} Apr 15 10:13:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:46 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2c45e950-cf42-46fa-b49d-4aebff18becf" returned: 0 in 0.619s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Lock "cinder-quobyte-2c45e950-cf42-46fa-b49d-4aebff18becf" released by "delete_volume" :: held 1.299s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:46 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285" returned: 0 in 0.613s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.313s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:46 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Cloning volume 281fb517-aedb-4c15-ace3-00f916ddbc02 to volume 02ae3537-b0af-40a2-8238-5d0edbf1b7a3 Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f25edb-6332-46c0-bfb2-6314d763a13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf13aa1a-4288-4b44-b252-c659cc0e1285', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdae0838-2461-47f7-97a5-335bc23ed627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Created reservations ['bfc40b6f-549e-4023-b29a-721f3e237c64', '6f6e20ec-6a86-4860-8de3-085e9fb6c7c5', '2b723491-ad61-4052-ba69-052178ff6663', 'fe8239f3-bea4-4cd0-83c2-cd4557bc0498'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Volume volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 (bf13aa1a-4288-4b44-b252-c659cc0e1285): created successfully Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdae0838-2461-47f7-97a5-335bc23ed627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (7b30e2a3-506c-42e2-907f-d2cb260a3546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-17926074-dc6c-475a-ae03-5f536379f4fc tempest-VolumesGetTest-300345946 None] Created volume successfully. Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Creating offline snapshot ebf20773-d12d-4242-b0cc-4782645d8e7e of volume 281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc45f23-5e3a-4964-a3b4-bf2cdb144b3d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:46 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:46 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:46 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 Apr 15 10:13:46 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:46 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.523s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Deleted volume successfully. Apr 15 10:13:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c9961702-1d3d-4d82-886f-a607190b24e2 tempest-AbsoluteLimitsTests-755293950 None] Lock "cinder-2c45e950-cf42-46fa-b49d-4aebff18becf-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:47 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02" returned: 0 in 0.639s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e 1G Apr 15 10:13:47 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-bf13aa1a-4288-4b44-b252-c659cc0e1285-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Lock "cinder-bf13aa1a-4288-4b44-b252-c659cc0e1285-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-bf13aa1a-4288-4b44-b252-c659cc0e1285" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-bf13aa1a-4288-4b44-b252-c659cc0e1285" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f444452a-434b-4f3a-bbca-d413e957703d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 Apr 15 10:13:47 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:48 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285" returned: 0 in 1.251s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:48 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285 Apr 15 10:13:48 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:48 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e 1G" returned: 0 in 1.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281fb517-aedb-4c15-ace3-00f916ddbc02 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:48 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281fb517-aedb-4c15-ace3-00f916ddbc02 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e Apr 15 10:13:48 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:49 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-bf13aa1a-4288-4b44-b252-c659cc0e1285" returned: 0 in 1.072s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-bf13aa1a-4288-4b44-b252-c659cc0e1285" released by "delete_volume" :: held 2.363s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Created reservations ['df51da4e-d411-4771-a841-839f0a6465d0', 'f2b4d3c5-243d-45a2-b975-03812bc91462', '090365ce-16eb-4671-9b6c-090bf64077d1', '5733c7b9-2b03-4594-913a-976f5146ba7d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:49 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:49 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:49 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-281fb517-aedb-4c15-ace3-00f916ddbc02 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e" returned: 0 in 1.332s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:49 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e is being set with open permissions: ugo+rw Apr 15 10:13:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:49 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e Apr 15 10:13:49 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Flow 'volume_create_manager' (3b1fb1b0-14e0-4561-b0e6-c455925610b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02af3bc7-c85d-44dc-afa6-54f0b4e222da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02af3bc7-c85d-44dc-afa6-54f0b4e222da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1538241223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f96ee0-7606-4d16-99ab-980649674783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e8f63a9b0346b5a64dc52b7fdd83d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:50Z,use_quota=True,user_id='2228327e0d664792b3031fcddd6c7ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f38c683-28b6-4f0a-9764-7aee49ee91f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f38c683-28b6-4f0a-9764-7aee49ee91f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbc9375-f113-4111-af6b-83dc55c808bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbc9375-f113-4111-af6b-83dc55c808bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f96ee0-7606-4d16-99ab-980649674783', 'volume_name': 'volume-f2f96ee0-7606-4d16-99ab-980649674783', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38ce0ca-ad43-47b7-9fc1-dab49360016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38ce0ca-ad43-47b7-9fc1-dab49360016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fa87b6-f725-4527-848f-325b7d948c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Volume f2f96ee0-7606-4d16-99ab-980649674783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f96ee0-7606-4d16-99ab-980649674783', 'volume_size': 1} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e" returned: 0 in 0.773s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-9f5252ac-24a5-49a7-838c-4d41ef1adc7b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Lock "cinder-9f5252ac-24a5-49a7-838c-4d41ef1adc7b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:50 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.info Apr 15 10:13:50 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" acquired by "delete_volume" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd96bb-eca1-43e3-b930-382b58b47c00]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:50 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.151s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Deleted volume successfully. Apr 15 10:13:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5d5c74e1-b68d-48b5-8fe3-3718f8c8d47c tempest-VolumesGetTest-300345946 None] Lock "cinder-bf13aa1a-4288-4b44-b252-c659cc0e1285-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:51 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b Apr 15 10:13:51 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:51 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.info" returned: 0 in 0.798s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:51 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.info is being set with open permissions: ugo+rw Apr 15 10:13:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:51 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.info Apr 15 10:13:51 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:52 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" returned: 0 in 1.389s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:52 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b Apr 15 10:13:52 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:52 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.info" returned: 0 in 0.879s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] snapshot: ebf20773-d12d-4242-b0cc-4782645d8e7e, volume: 02ae3537-b0af-40a2-8238-5d0edbf1b7a3, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[144b58f1-a050-4e15-bbe7-9c6ac6906691]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:52 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e Apr 15 10:13:52 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Flow 'volume_create_manager' (d25d8b7e-369b-407d-a3f1-1038ecb6f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f515126-80f5-4738-a603-78b409ba822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=114,cinder:INSERT=42,cinder:UPDATE=165,cinder:DELETE=10 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f515126-80f5-4738-a603-78b409ba822e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-978084478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e48ebd5-85ec-40ef-bf57-4ba05f80c17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02d714af0447ba9527b0633c118f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:53Z,use_quota=True,user_id='62caf6acc63c44fcbc801f89ec9567dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc839da-ccff-4be6-aca7-c1d6d6af8c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc839da-ccff-4be6-aca7-c1d6d6af8c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb9e464-2401-4b27-91dd-3502a054fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb9e464-2401-4b27-91dd-3502a054fef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e48ebd5-85ec-40ef-bf57-4ba05f80c17e', 'volume_name': 'volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e465a111-cb4b-4488-a379-6aa439ba88fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e465a111-cb4b-4488-a379-6aa439ba88fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3914b45e-858f-4286-891f-d64ad8fde035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Volume 5e48ebd5-85ec-40ef-bf57-4ba05f80c17e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e', 'volume_size': 1} Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:52 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" returned: 0 in 0.697s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-9f5252ac-24a5-49a7-838c-4d41ef1adc7b" released by "delete_volume" :: held 2.164s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=116,cinder:INSERT=32,cinder:UPDATE=143,cinder:DELETE=17 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Created reservations ['419ff63a-811f-4978-9898-1e37564f6f71', '6c64ff35-1737-44a6-ba1c-b1663df25dcd', '3459b3ed-d37d-4423-9a52-eef7165bf070', 'e4716e06-c672-4f62-a9cf-3b5022a5aa31'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:53 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:53 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-e41baa2c-0348-4a61-87c6-de948c6dcda7-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Lock "cinder-e41baa2c-0348-4a61-87c6-de948c6dcda7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-e41baa2c-0348-4a61-87c6-de948c6dcda7" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-e41baa2c-0348-4a61-87c6-de948c6dcda7" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:53 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e" returned: 0 in 0.951s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-281fb517-aedb-4c15-ace3-00f916ddbc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a038f76e-e428-4e7c-9172-d65a4273ee2f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b6585a-8386-479d-ac34-da76b35f4e54]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:53 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 Apr 15 10:13:53 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:53 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 Apr 15 10:13:53 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:53 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.672s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Deleted volume successfully. Apr 15 10:13:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b3ad7a1-0903-4dd0-b1d8-b5a75e3791d7 tempest-VolumesGetTest-300345946 None] Lock "cinder-9f5252ac-24a5-49a7-838c-4d41ef1adc7b-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:54 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02" returned: 0 in 0.645s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:54 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7" returned: 0 in 0.684s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:54 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 Apr 15 10:13:54 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:54 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7 Apr 15 10:13:54 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:54 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e41baa2c-0348-4a61-87c6-de948c6dcda7" returned: 0 in 0.489s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-e41baa2c-0348-4a61-87c6-de948c6dcda7" released by "delete_volume" :: held 1.275s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:54 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Created reservations ['71df3af6-6be2-4938-9534-1ee0517e4119', '5a32ade1-ad31-4495-8e34-f52a8bb03756', 'f3ed3e6e-1e0e-43a6-81de-c3e4b9cf3e8e', '91262904-b0fc-456a-98f5-fa8b09a41eab'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:55 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:13:55 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:57 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 2.355s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Deleted volume successfully. Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d55cfb9f-dbbc-4aea-93b3-09b67e275f63 tempest-VolumesGetTest-300345946 None] Lock "cinder-e41baa2c-0348-4a61-87c6-de948c6dcda7-delete_volume" released by "delete_volume" :: held 4.202s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (999c17c0-dac2-46bc-ae46-6f7f67e9ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8305c8-7f0e-44a4-912f-9756c025702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:57 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" returned: 0 in 3.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8305c8-7f0e-44a4-912f-9756c025702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1967106356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a384285-f9dd-4b6f-9865-b3fe89e256dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:57Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93c56e3-d954-4986-a2b9-ba946aad4798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93c56e3-d954-4986-a2b9-ba946aad4798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06258f57-7ae0-4d4d-828a-0795075dbc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.image.glance [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Creating Keystone auth plugin from conf {{(pid=82850) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[93feb350-717a-4eb0-bab0-7bd871927028]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:57 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 Apr 15 10:13:57 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06258f57-7ae0-4d4d-828a-0795075dbc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a384285-f9dd-4b6f-9865-b3fe89e256dc', 'volume_name': 'volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff578dad-1638-4bc6-a843-9a661f562df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff578dad-1638-4bc6-a843-9a661f562df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0022555-73f2-4339-ba40-70829ae4bb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Volume 7a384285-f9dd-4b6f-9865-b3fe89e256dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:13:57 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Trying to clone 7a384285-f9dd-4b6f-9865-b3fe89e256dc from image 019e5b32-dfb6-4970-afa1-ec198cc6628d at location (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]). {{(pid=82850) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:13:58 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4376548-fcc4-44da-9046-6d5e4cdc08d6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD Apr 15 10:13:58 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:58 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02" returned: 0 in 0.853s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02, size 1024.00 MB, duration 3.46 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:58 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Converted 1024.00 MB image at 295.84 MB/s Apr 15 10:13:58 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 is being set with open permissions: ugo+rw Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 Apr 15 10:13:58 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:58 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d is fetched for user ab87706de6344fdd8a0489fd68c1a87d. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea22abb2-9968-40ef-95e8-c9fd30bc37d1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD Apr 15 10:13:58 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:58 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" returned: 0 in 0.473s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" released by "_copy_volume_from_snapshot" :: held 6.508s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-ebf20773-d12d-4242-b0cc-4782645d8e7e" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-ebf20773-d12d-4242-b0cc-4782645d8e7e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Deleting offline snapshot ebf20773-d12d-4242-b0cc-4782645d8e7e of volume 281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] snapshot_file for this snap is: volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3374a80-40f4-4ca9-bc9d-eb68a74eba1c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:59 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e Apr 15 10:13:59 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:59 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:59 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e" returned: 0 in 0.564s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-281fb517-aedb-4c15-ace3-00f916ddbc02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c797762a-3bbe-4258-aa91-c2eb296f26d7]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:59 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 Apr 15 10:13:59 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:00 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02" returned: 0 in 0.529s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:00 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e Apr 15 10:14:00 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:00 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e" returned: 0 in 0.545s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:00 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e Apr 15 10:14:00 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:01 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02.ebf20773-d12d-4242-b0cc-4782645d8e7e" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-ebf20773-d12d-4242-b0cc-4782645d8e7e" released by "_delete_snapshot" :: held 2.210s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.883s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.537s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1538241223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f96ee0-7606-4d16-99ab-980649674783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e8f63a9b0346b5a64dc52b7fdd83d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:50Z,use_quota=True,user_id='2228327e0d664792b3031fcddd6c7ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Creating volume f2f96ee0-7606-4d16-99ab-980649674783 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:01 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf9ae00-8c94-4344-a39b-16d5263e1989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3', 'volume_size': 1, 'source_volid': '281fb517-aedb-4c15-ace3-00f916ddbc02', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:01 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 1073741824 Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513df12f-3636-4b70-a79f-f5abc023a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:01 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Volume volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 (02ae3537-b0af-40a2-8238-5d0edbf1b7a3): created successfully Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513df12f-3636-4b70-a79f-f5abc023a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Flow 'volume_create_manager' (1f059679-8dc0-4545-9138-f2d9a0a30c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-335009bf-70d7-472d-9075-b65a66952dcf tempest-VolumeDependencyTests-545440044 None] Created volume successfully. Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-281fb517-aedb-4c15-ace3-00f916ddbc02-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Lock "cinder-281fb517-aedb-4c15-ace3-00f916ddbc02-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-281fb517-aedb-4c15-ace3-00f916ddbc02" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-281fb517-aedb-4c15-ace3-00f916ddbc02" acquired by "delete_volume" :: waited 0.024s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53f3c21-46c4-480c-817a-75edc74b991d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:01 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 Apr 15 10:14:01 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:01 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 1073741824" returned: 0 in 0.783s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:02 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 Apr 15 10:14:02 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:02 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02" returned: 0 in 0.634s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:02 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02 Apr 15 10:14:02 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:02 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783" returned: 0 in 0.511s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.697s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-978084478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e48ebd5-85ec-40ef-bf57-4ba05f80c17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02d714af0447ba9527b0633c118f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:53Z,use_quota=True,user_id='62caf6acc63c44fcbc801f89ec9567dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Creating volume 5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:02 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fa87b6-f725-4527-848f-325b7d948c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f96ee0-7606-4d16-99ab-980649674783', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e6813-5de5-4947-87ec-3a1e3ac5f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:02 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Volume volume-f2f96ee0-7606-4d16-99ab-980649674783 (f2f96ee0-7606-4d16-99ab-980649674783): created successfully Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e6813-5de5-4947-87ec-3a1e3ac5f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Flow 'volume_create_manager' (3b1fb1b0-14e0-4561-b0e6-c455925610b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5c224bbe-16f9-429a-a0b3-2800444dafe1 tempest-ServerRescueNegativeTestJSON-221304175 None] Created volume successfully. Apr 15 10:14:02 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e 1073741824 Apr 15 10:14:02 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-281fb517-aedb-4c15-ace3-00f916ddbc02" returned: 0 in 0.715s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-281fb517-aedb-4c15-ace3-00f916ddbc02" released by "delete_volume" :: held 1.388s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Created reservations ['a992bdb9-1b4b-4591-9c98-899f2151e66b', '81edf01f-7eaf-43d6-8030-2b37f7791c2a', '3e0d7b89-ed71-4ce7-851d-93834eaa5714', 'daed8ba0-f7d2-4a23-8b53-b3df3c5fff68'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:03 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e 1073741824" returned: 0 in 0.714s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:03 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:03 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e Apr 15 10:14:03 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.495s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Deleted volume successfully. Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2453662f-71ee-4e69-81c1-1b8da2870b7c tempest-VolumeDependencyTests-545440044 None] Lock "cinder-281fb517-aedb-4c15-ace3-00f916ddbc02-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:03 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" returned: 0 in 0.489s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.540s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1967106356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a384285-f9dd-4b6f-9865-b3fe89e256dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:57Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Creating volume 7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:03 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3914b45e-858f-4286-891f-d64ad8fde035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c157aa0a-93d3-4686-b2bd-ca9a0de4c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:03 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Volume volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e (5e48ebd5-85ec-40ef-bf57-4ba05f80c17e): created successfully Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c157aa0a-93d3-4686-b2bd-ca9a0de4c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Flow 'volume_create_manager' (d25d8b7e-369b-407d-a3f1-1038ecb6f328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:03 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc 1073741824 Apr 15 10:14:03 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-756fab90-3a03-486e-9166-4b158a282cb0 tempest-VolumesDeleteCascade-644994145 None] Created volume successfully. Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-02ae3537-b0af-40a2-8238-5d0edbf1b7a3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Lock "cinder-02ae3537-b0af-40a2-8238-5d0edbf1b7a3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[480335ed-1a5d-4ce1-91b8-97b17e9f4c6e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:04 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 Apr 15 10:14:04 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:04 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc 1073741824" returned: 0 in 0.919s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:04 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" returned: 0 in 0.669s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:04 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc Apr 15 10:14:04 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:04 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3 Apr 15 10:14:04 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:05 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc" returned: 0 in 0.633s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.939s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Creating offline snapshot 2144d7a6-8dc4-4009-b8ee-8c6ba732998b of volume 5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Attempting download of 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 7a384285-f9dd-4b6f-9865-b3fe89e256dc. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed294026-4f46-4b64-b50c-46587de154e6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bd5642-240a-4400-aa75-fddc5225de8d]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_4dzzo84k {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:05 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e Apr 15 10:14:05 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:05 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" returned: 0 in 0.915s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-02ae3537-b0af-40a2-8238-5d0edbf1b7a3" released by "delete_volume" :: held 1.685s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:05 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_4dzzo84k Apr 15 10:14:05 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Created reservations ['df6c25c0-fe02-4eeb-ac56-d45a2a4dc674', 'bcdbac58-9dd0-4154-a7b4-f8f8c6d4e0e7', '74c7fdb6-ce6d-47f1-909b-e1a6b8dd39ce', 'da001559-9065-4a3d-a17f-b9415d71a8cc'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:05 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:05 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_4dzzo84k" returned: 0 in 0.707s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_4dzzo84k {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-abb1856f-2558-4dbb-a825-a02cf529692a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-abb1856f-2558-4dbb-a825-a02cf529692a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "cinder-quobyte-abb1856f-2558-4dbb-a825-a02cf529692a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:06 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_4dzzo84k Apr 15 10:14:06 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-abb1856f-2558-4dbb-a825-a02cf529692a" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f0a1b4-376d-422a-824d-5e8aab6bffff]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:06 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a Apr 15 10:14:06 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" returned: 0 in 1.351s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:06 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b 1G Apr 15 10:14:06 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.127s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:06 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Deleted volume successfully. Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cd2d543a-daba-45a9-a6e2-94ee7905af4d tempest-VolumeDependencyTests-545440044 None] Lock "cinder-02ae3537-b0af-40a2-8238-5d0edbf1b7a3-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:07 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_4dzzo84k" returned: 1 in 1.052s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_019e5b32-dfb6-4970-afa1-ec198cc6628d_4dzzo84k' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c65bbe5-e016-4ee9-ac12-a6887ce5981f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:07 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD Apr 15 10:14:07 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:07 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a" returned: 0 in 1.121s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:07 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a Apr 15 10:14:07 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:07 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b 1G" returned: 0 in 0.950s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:07 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b Apr 15 10:14:07 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:08 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD" returned: 0 in 0.966s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] 019e5b32-dfb6-4970-afa1-ec198cc6628d was qcow2, converting to raw {{(pid=82850) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:08 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc Apr 15 10:14:08 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:08 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-abb1856f-2558-4dbb-a825-a02cf529692a" returned: 0 in 0.706s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-quobyte-abb1856f-2558-4dbb-a825-a02cf529692a" released by "delete_volume" :: held 1.886s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Created reservations ['c77dfa48-85ff-41df-8c52-20fcdddaa288', 'c3ef68ba-decd-434e-9dd3-3ef04b160f5c', 'a9487a80-59d6-4caf-8f2e-ac358192a520', '4fa665ec-def3-4a52-828b-f32872fbfc3c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:08 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:08 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:08 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b" returned: 0 in 1.000s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:08 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b is being set with open permissions: ugo+rw Apr 15 10:14:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:08 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b Apr 15 10:14:08 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:09 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b" returned: 0 in 0.532s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:09 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.info Apr 15 10:14:09 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:09 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.889s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Deleted volume successfully. Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-a98c2c87-e6cf-431a-b63a-cdd034a9c545 tempest-VolumeDependencyTests-545440044 None] Lock "cinder-abb1856f-2558-4dbb-a825-a02cf529692a-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:09 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc" returned: 0 in 1.404s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_019e5b32-dfb6-4970-afa1-ec198cc6628d_2lg71mikdevstack@QuobyteHD, size 112.00 MB, duration 1.40 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:14:09 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Converted 112.00 MB image at 79.74 MB/s Apr 15 10:14:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:09 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc 1G Apr 15 10:14:09 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:10 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.info" returned: 0 in 0.830s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:10 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.info is being set with open permissions: ugo+rw Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:10 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.info Apr 15 10:14:10 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:10 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc 1G" returned: 0 in 0.556s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ffc58c-29e1-4177-aad8-976af38ed8dc]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:10 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc Apr 15 10:14:10 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:10 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc" returned: 0 in 0.554s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:10 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc Apr 15 10:14:10 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:10 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.info" returned: 0 in 0.729s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.522s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3b8b057f-f23f-479b-ba7b-0677f80853dd tempest-VolumesDeleteCascade-644994145 None] Create snapshot completed successfully Apr 15 10:14:11 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc" returned: 1 in 0.665s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Downloaded image 019e5b32-dfb6-4970-afa1-ec198cc6628d ((None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}])) to volume 7a384285-f9dd-4b6f-9865-b3fe89e256dc successfully. {{(pid=82850) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Temporary image 019e5b32-dfb6-4970-afa1-ec198cc6628d for user ab87706de6344fdd8a0489fd68c1a87d is deleted. {{(pid=82850) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.volume_utils [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Marking volume 7a384285-f9dd-4b6f-9865-b3fe89e256dc as bootable. {{(pid=82850) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Copying metadata from image 019e5b32-dfb6-4970-afa1-ec198cc6628d to 7a384285-f9dd-4b6f-9865-b3fe89e256dc. {{(pid=82850) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Creating volume glance metadata for volume 7a384285-f9dd-4b6f-9865-b3fe89e256dc backed by image 019e5b32-dfb6-4970-afa1-ec198cc6628d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82850) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0022555-73f2-4339-ba40-70829ae4bb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc', 'volume_size': 1, 'image_id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/019e5b32-dfb6-4970-afa1-ec198cc6628d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dcd21c7ff0794861ae662810a5464d82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '019e5b32-dfb6-4970-afa1-ec198cc6628d', 'created_at': datetime.datetime(2026, 4, 15, 8, 4, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 4, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/019e5b32-dfb6-4970-afa1-ec198cc6628d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a807d3c-d33a-406c-b94f-11ef15d962d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:11 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Volume volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc (7a384285-f9dd-4b6f-9865-b3fe89e256dc): created successfully Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a807d3c-d33a-406c-b94f-11ef15d962d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (999c17c0-dac2-46bc-ae46-6f7f67e9ce27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b5eb57e0-87fb-484c-864f-c115e53e13fc tempest-VolumesGetTest-300345946 None] Created volume successfully. Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Creating offline snapshot 1b1b2955-0945-4b28-a9ab-354a9ff2595c of volume 5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[161be334-5af7-4d27-9ab9-e8dd9200334a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:12 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b Apr 15 10:14:12 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:12 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b" returned: 0 in 0.662s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:12 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c 1G Apr 15 10:14:12 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (30fb384c-b611-44b2-a4b4-520f3ce3ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a582850-8ca5-405b-85a8-bd99bfa82e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:14 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a582850-8ca5-405b-85a8-bd99bfa82e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-347394312',display_name='tempest-VolumesGetTest-Volume-1478487478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41545eb0-ad19-4097-bee1-0785461ca08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:14Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f36621-e106-4ed2-85e7-821bcb4e30bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f36621-e106-4ed2-85e7-821bcb4e30bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4235024-e2f5-4876-ab3e-4315586d5045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4235024-e2f5-4876-ab3e-4315586d5045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41545eb0-ad19-4097-bee1-0785461ca08c', 'volume_name': 'volume-41545eb0-ad19-4097-bee1-0785461ca08c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f87b676-b063-4f53-8cc2-87f73620088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f87b676-b063-4f53-8cc2-87f73620088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7a9af1-8b46-490d-8b0b-586317f29b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Volume 41545eb0-ad19-4097-bee1-0785461ca08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41545eb0-ad19-4097-bee1-0785461ca08c', 'volume_size': 1} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c 1G" returned: 0 in 1.577s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:14 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c Apr 15 10:14:14 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:14 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c" returned: 0 in 0.587s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:14 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c is being set with open permissions: ugo+rw Apr 15 10:14:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:14 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c Apr 15 10:14:14 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:15 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c" returned: 0 in 0.955s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.871s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-347394312',display_name='tempest-VolumesGetTest-Volume-1478487478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41545eb0-ad19-4097-bee1-0785461ca08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57d62c824ad42c5b8a4973b33c59f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:14Z,use_quota=True,user_id='ab87706de6344fdd8a0489fd68c1a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Creating volume 41545eb0-ad19-4097-bee1-0785461ca08c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:15 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:15 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c 1073741824 Apr 15 10:14:15 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e52b4208-1c04-4ecf-951c-1905f021b0a0 tempest-VolumesDeleteCascade-644994145 None] Create snapshot completed successfully Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Performing cascade delete. {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-1b1b2955-0945-4b28-a9ab-354a9ff2595c-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-1b1b2955-0945-4b28-a9ab-354a9ff2595c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-1b1b2955-0945-4b28-a9ab-354a9ff2595c" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-1b1b2955-0945-4b28-a9ab-354a9ff2595c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Deleting offline snapshot 1b1b2955-0945-4b28-a9ab-354a9ff2595c of volume 5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] snapshot_file for this snap is: volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac241e2-a054-4a3a-a11f-005acebf63f3]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:16 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c Apr 15 10:14:16 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:17 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c 1073741824" returned: 0 in 1.285s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:17 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c Apr 15 10:14:17 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:17 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c" returned: 0 in 0.890s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7a9af1-8b46-490d-8b0b-586317f29b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41545eb0-ad19-4097-bee1-0785461ca08c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b63234-2d4f-4019-8550-7e7243aba24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:18 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Volume volume-41545eb0-ad19-4097-bee1-0785461ca08c (41545eb0-ad19-4097-bee1-0785461ca08c): created successfully Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b63234-2d4f-4019-8550-7e7243aba24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Flow 'volume_create_manager' (30fb384c-b611-44b2-a4b4-520f3ce3ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-178330aa-fcc2-41e3-acd2-5f5e7987acff tempest-VolumesGetTest-300345946 None] Created volume successfully. Apr 15 10:14:18 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c" returned: 0 in 1.640s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9f92f-4f57-4f1f-a506-e1ab7ff45ff4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:18 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b Apr 15 10:14:18 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-41545eb0-ad19-4097-bee1-0785461ca08c-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Lock "cinder-41545eb0-ad19-4097-bee1-0785461ca08c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-41545eb0-ad19-4097-bee1-0785461ca08c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-41545eb0-ad19-4097-bee1-0785461ca08c" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3a83b7-73b0-4b12-a2e0-dafadfde75c5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:19 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c Apr 15 10:14:19 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b" returned: 0 in 1.052s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:19 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:19 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c Apr 15 10:14:19 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:19 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c" returned: 0 in 0.975s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:20 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c Apr 15 10:14:20 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:20 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c" returned: 0 in 0.920s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:20 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c Apr 15 10:14:20 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:21 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.1b1b2955-0945-4b28-a9ab-354a9ff2595c" returned: 0 in 0.745s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-1b1b2955-0945-4b28-a9ab-354a9ff2595c" released by "_delete_snapshot" :: held 4.483s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" released by "delete_snapshot" :: held 4.503s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Created reservations ['48a1ac23-c73c-470d-a9a3-7d13a62574e7', '77adaa7c-7001-4b29-b59e-670f39dbfdc5', 'df5e4dbc-988a-4a7e-9978-a518bc26c32e', '8f962584-aa68-4754-88f3-65fd99ea7f55'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:21 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-41545eb0-ad19-4097-bee1-0785461ca08c" returned: 0 in 1.334s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-41545eb0-ad19-4097-bee1-0785461ca08c" released by "delete_volume" :: held 2.416s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Delete snapshot completed successfully. Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-1b1b2955-0945-4b28-a9ab-354a9ff2595c-delete_snapshot" released by "delete_snapshot" :: held 4.895s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-2144d7a6-8dc4-4009-b8ee-8c6ba732998b-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-2144d7a6-8dc4-4009-b8ee-8c6ba732998b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-2144d7a6-8dc4-4009-b8ee-8c6ba732998b" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Created reservations ['48829342-3acc-437c-8402-5d8e6ed82393', '64da519e-65cb-4123-8c16-35f8bb19d452', '4b51bbf2-bd3b-43e9-a12a-2b994539470c', '45108df5-2c0e-43d2-bef2-df33ce7408f8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-2144d7a6-8dc4-4009-b8ee-8c6ba732998b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Deleting offline snapshot 2144d7a6-8dc4-4009-b8ee-8c6ba732998b of volume 5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] snapshot_file for this snap is: volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[254051d4-04b4-4d88-80f3-b1fb21ae6026]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:21 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:21 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:21 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b Apr 15 10:14:21 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-7a384285-f9dd-4b6f-9865-b3fe89e256dc-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Acquiring lock "cinder-f2f96ee0-7606-4d16-99ab-980649674783-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Lock "cinder-7a384285-f9dd-4b6f-9865-b3fe89e256dc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "cinder-f2f96ee0-7606-4d16-99ab-980649674783-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Acquiring lock "cinder-quobyte-f2f96ee0-7606-4d16-99ab-980649674783" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Acquiring lock "cinder-quobyte-7a384285-f9dd-4b6f-9865-b3fe89e256dc" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "cinder-quobyte-f2f96ee0-7606-4d16-99ab-980649674783" acquired by "delete_volume" :: waited 0.099s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-7a384285-f9dd-4b6f-9865-b3fe89e256dc" acquired by "delete_volume" :: waited 0.060s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fec1b0-4749-4f22-8d54-11c0afc238ff]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eccd03e-12ab-4b28-9eb5-7f76432c694a]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:23 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 Apr 15 10:14:23 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:23 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc Apr 15 10:14:23 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:23 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.556s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:23 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Deleted volume successfully. Apr 15 10:14:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8c5f6845-2c99-4b5b-a307-451e8787625c tempest-VolumesGetTest-300345946 None] Lock "cinder-41545eb0-ad19-4097-bee1-0785461ca08c-delete_volume" released by "delete_volume" :: held 4.426s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:23 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b" returned: 0 in 1.785s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1399aa38-7e77-4403-9e7d-727650831538]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:23 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e Apr 15 10:14:23 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:24 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783" returned: 0 in 1.595s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:24 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:24 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783 Apr 15 10:14:24 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc" returned: 0 in 1.614s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:24 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" returned: 0 in 1.277s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:24 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b Apr 15 10:14:24 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:24 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc Apr 15 10:14:24 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:25 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc" returned: 1 in 1.143s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:14:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:25 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc Apr 15 10:14:25 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:25 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f2f96ee0-7606-4d16-99ab-980649674783" returned: 0 in 1.360s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "cinder-quobyte-f2f96ee0-7606-4d16-99ab-980649674783" released by "delete_volume" :: held 3.051s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Created reservations ['f0b4bfd6-2964-437d-89f6-12ca53ff89cd', '4a25278c-faaf-482e-a015-2f75ecc90d1a', '8f748e6a-a9fd-41ee-8c57-57dfa7fcbec9', '2667634f-7061-48c7-a9f9-cabd2869abba'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:26 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:26 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:26 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b" returned: 0 in 1.735s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:26 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b Apr 15 10:14:26 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:27 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a384285-f9dd-4b6f-9865-b3fe89e256dc" returned: 0 in 1.440s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Lock "cinder-quobyte-7a384285-f9dd-4b6f-9865-b3fe89e256dc" released by "delete_volume" :: held 4.322s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Created reservations ['b9f0127d-bf8f-4f8b-a08f-177e6ec8066e', '3feaeeb5-2a4d-44f1-afcf-b5bffd043cc4', '9e4ecd11-94d7-4389-8893-caef8f436f92', '947224e0-7e58-4475-bba8-f6b1b7302442'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:27 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:27 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:27 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e.2144d7a6-8dc4-4009-b8ee-8c6ba732998b" returned: 0 in 1.167s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:27 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.635s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-2144d7a6-8dc4-4009-b8ee-8c6ba732998b" released by "_delete_snapshot" :: held 6.239s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Deleted volume successfully. Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" released by "delete_snapshot" :: held 6.280s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d66564f-9137-4362-afcd-b3255b6bb555 tempest-ServerRescueNegativeTestJSON-221304175 None] Lock "cinder-f2f96ee0-7606-4d16-99ab-980649674783-delete_volume" released by "delete_volume" :: held 5.172s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Created reservations ['7d6327d7-4eac-4416-8796-7a0ca1d98870', 'b57bfd21-bc15-469b-b57b-35454befc660', 'e92838bd-6ffd-4e6e-8a52-b5e857f97dbc', 'ff1df554-9a88-4d63-9ea1-fac2cf41806f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Delete snapshot completed successfully. Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-2144d7a6-8dc4-4009-b8ee-8c6ba732998b-delete_snapshot" released by "delete_snapshot" :: held 6.432s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Snapshots deleted, issuing volume delete {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf65752-8fa7-43de-b7ea-0c6d88468f79]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:27 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e Apr 15 10:14:27 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:28 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.775s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:28 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Deleted volume successfully. Apr 15 10:14:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0eff0292-8281-44c6-bf73-db1152d2bf55 tempest-VolumesGetTest-300345946 None] Lock "cinder-7a384285-f9dd-4b6f-9865-b3fe89e256dc-delete_volume" released by "delete_volume" :: held 5.738s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:28 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" returned: 0 in 0.987s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:28 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e Apr 15 10:14:28 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:29 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" returned: 0 in 0.566s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e" released by "delete_volume" :: held 1.602s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Created reservations ['946c9c9b-5e2a-423b-b83f-4312e8bc2f0e', 'f06f55c5-dd09-4a0b-ba01-a58e17d8fc67', '0b3881ce-6d53-4ccb-8aca-f1297cebb054', '03534438-bc69-4004-99f4-4c1741b9582b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:29 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:29 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:30 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.789s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Deleted volume successfully. Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1e6457d6-4894-425f-8461-bf7679042169 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-5e48ebd5-85ec-40ef-bf57-4ba05f80c17e-delete_volume" released by "delete_volume" :: held 14.098s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Flow 'volume_create_manager' (a6c14a95-ce1b-4cf7-94cb-5d23994c8845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e60595-98fe-48fd-9071-e407deacdf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e60595-98fe-48fd-9071-e407deacdf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1621001628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed2be58-8586-419e-a35b-0164d8d6ab82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02d714af0447ba9527b0633c118f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:31Z,use_quota=True,user_id='62caf6acc63c44fcbc801f89ec9567dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a80656c-ba20-492d-b548-53d745c04068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a80656c-ba20-492d-b548-53d745c04068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87e9e91-86bc-4bff-8808-2e2bd96ff6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87e9e91-86bc-4bff-8808-2e2bd96ff6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed2be58-8586-419e-a35b-0164d8d6ab82', 'volume_name': 'volume-8ed2be58-8586-419e-a35b-0164d8d6ab82', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c070b97-42bb-45b4-a6c8-47e58b786583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c070b97-42bb-45b4-a6c8-47e58b786583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1caf15-6a82-4ba4-9ca2-e7ebe6d24a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:30 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Volume 8ed2be58-8586-419e-a35b-0164d8d6ab82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed2be58-8586-419e-a35b-0164d8d6ab82', 'volume_size': 1} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1621001628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed2be58-8586-419e-a35b-0164d8d6ab82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02d714af0447ba9527b0633c118f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:31Z,use_quota=True,user_id='62caf6acc63c44fcbc801f89ec9567dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Creating volume 8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:30 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:30 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 1073741824 Apr 15 10:14:30 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:31 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 1073741824" returned: 0 in 0.817s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:31 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 Apr 15 10:14:31 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:32 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82" returned: 0 in 0.690s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1caf15-6a82-4ba4-9ca2-e7ebe6d24a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed2be58-8586-419e-a35b-0164d8d6ab82', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38eee8c8-643f-4ee2-a56b-b8b549021749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:32 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Volume volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 (8ed2be58-8586-419e-a35b-0164d8d6ab82): created successfully Apr 15 10:14:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38eee8c8-643f-4ee2-a56b-b8b549021749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Flow 'volume_create_manager' (a6c14a95-ce1b-4cf7-94cb-5d23994c8845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ff9752ce-a1d2-4b8c-8cda-18af223fb1fd tempest-VolumesDeleteCascade-644994145 None] Created volume successfully. Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Creating offline snapshot 010d6798-f105-453f-91d0-e46ad3f9ed8a of volume 8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5165515d-6cd5-48f1-a368-3b98c96f691e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:33 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 Apr 15 10:14:33 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:33 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:33 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Flow 'volume_create_manager' (801068d8-3343-4efa-b442-4c089a9f8a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22a6d30-c532-4848-a6b7-41c85c817a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22a6d30-c532-4848-a6b7-41c85c817a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2079932007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826f3629-8e9a-499e-94c6-54362aa4e936,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ba316208ca44ddafd25b380bb1824a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:34Z,use_quota=True,user_id='e6894afebe3d48c384fed33f77d3847d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b31e14-d45f-473f-9019-0f8aec6b489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8b31e14-d45f-473f-9019-0f8aec6b489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8905d110-b3e9-4ddf-866c-9051f903dd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8905d110-b3e9-4ddf-866c-9051f903dd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826f3629-8e9a-499e-94c6-54362aa4e936', 'volume_name': 'volume-826f3629-8e9a-499e-94c6-54362aa4e936', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeace6d-2078-4539-ae26-1857f2adee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeace6d-2078-4539-ae26-1857f2adee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c163f51c-1093-4272-b723-dec37912d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:34 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Volume 826f3629-8e9a-499e-94c6-54362aa4e936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826f3629-8e9a-499e-94c6-54362aa4e936', 'volume_size': 1} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:34 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82" returned: 0 in 1.255s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:34 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a 1G Apr 15 10:14:34 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:34 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.171s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:35 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a 1G" returned: 0 in 0.655s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:35 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a Apr 15 10:14:35 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:35 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a" returned: 0 in 0.588s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:35 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a is being set with open permissions: ugo+rw Apr 15 10:14:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:35 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a Apr 15 10:14:35 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:36 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a" returned: 0 in 0.550s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:36 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.info Apr 15 10:14:36 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:36 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.info" returned: 0 in 0.589s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:36 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.info is being set with open permissions: ugo+rw Apr 15 10:14:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:36 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.info Apr 15 10:14:36 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:37 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.info" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.061s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2079932007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826f3629-8e9a-499e-94c6-54362aa4e936,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ba316208ca44ddafd25b380bb1824a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:34Z,use_quota=True,user_id='e6894afebe3d48c384fed33f77d3847d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Creating volume 826f3629-8e9a-499e-94c6-54362aa4e936 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:37 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0c091979-9e20-4aa5-9aa0-79e34ecafa5b tempest-VolumesDeleteCascade-644994145 None] Create snapshot completed successfully Apr 15 10:14:37 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 1073741824 Apr 15 10:14:37 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:38 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 1073741824" returned: 0 in 0.697s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:38 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 Apr 15 10:14:38 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:38 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936" returned: 0 in 0.482s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c163f51c-1093-4272-b723-dec37912d419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826f3629-8e9a-499e-94c6-54362aa4e936', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bfad7b-1016-4ef5-b2d0-ec538cb7773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Volume volume-826f3629-8e9a-499e-94c6-54362aa4e936 (826f3629-8e9a-499e-94c6-54362aa4e936): created successfully Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bfad7b-1016-4ef5-b2d0-ec538cb7773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Flow 'volume_create_manager' (801068d8-3343-4efa-b442-4c089a9f8a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-49117ea3-c9aa-4962-9f88-c7a77726905d tempest-VolumesListTestJSON-900690288 None] Created volume successfully. Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Flow 'volume_create_manager' (679a590f-0b7b-4545-b183-661c71efa7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdd1e7e-bbf5-4573-b914-6e7e5e6bcf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdd1e7e-bbf5-4573-b914-6e7e5e6bcf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-970269743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c029d5e-4ed9-4430-8960-b06834a7ada5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22439bc732a04a629b22462a3572320f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:39Z,use_quota=True,user_id='cd37bc2d968943e5bf368630d64b1be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bff826b-fec4-401a-b52f-02e0a53ec37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bff826b-fec4-401a-b52f-02e0a53ec37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb95dd27-9bc5-4cd9-bf0c-1c18819f4441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb95dd27-9bc5-4cd9-bf0c-1c18819f4441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c029d5e-4ed9-4430-8960-b06834a7ada5', 'volume_name': 'volume-7c029d5e-4ed9-4430-8960-b06834a7ada5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46072da0-83be-48a6-8344-3f41efb669cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46072da0-83be-48a6-8344-3f41efb669cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9288f9f-bd62-47b0-ac9e-d8455718ddd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Volume 7c029d5e-4ed9-4430-8960-b06834a7ada5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c029d5e-4ed9-4430-8960-b06834a7ada5', 'volume_size': 1} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-970269743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c029d5e-4ed9-4430-8960-b06834a7ada5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22439bc732a04a629b22462a3572320f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:39Z,use_quota=True,user_id='cd37bc2d968943e5bf368630d64b1be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Creating volume 7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:38 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:38 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 1073741824 Apr 15 10:14:38 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Flow 'volume_create_manager' (06d4d387-8669-4d14-b045-ecd61b65ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6985d08-9cae-40d7-9be8-df0b9e7fdd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6985d08-9cae-40d7-9be8-df0b9e7fdd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1488393976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bc88cc-0ae9-4483-b051-ed376f3fc337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf02d714af0447ba9527b0633c118f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=010d6798-f105-453f-91d0-e46ad3f9ed8a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:39Z,use_quota=True,user_id='62caf6acc63c44fcbc801f89ec9567dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04ebc0b-9424-46f0-ac30-49cec45ec920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04ebc0b-9424-46f0-ac30-49cec45ec920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c39668-a6f2-48e6-9ff4-0700d5f53bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c39668-a6f2-48e6-9ff4-0700d5f53bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59bc88cc-0ae9-4483-b051-ed376f3fc337', 'volume_name': 'volume-59bc88cc-0ae9-4483-b051-ed376f3fc337', 'volume_size': 1, 'snapshot_id': '010d6798-f105-453f-91d0-e46ad3f9ed8a'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f1b82f-a2a2-4e1a-b897-c94ad93118f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f1b82f-a2a2-4e1a-b897-c94ad93118f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d559acf-13b5-4890-9e71-652f12c8c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Volume 59bc88cc-0ae9-4483-b051-ed376f3fc337: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59bc88cc-0ae9-4483-b051-ed376f3fc337', 'volume_size': 1, 'snapshot_id': '010d6798-f105-453f-91d0-e46ad3f9ed8a'} Apr 15 10:14:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:39 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 1073741824" returned: 0 in 0.551s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:39 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 Apr 15 10:14:39 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Flow 'volume_create_manager' (43366a2e-23d9-470f-8556-9402f84e3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6da0cb-cc7d-4795-adca-98073207a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6da0cb-cc7d-4795-adca-98073207a02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2051735526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccc81ca-94e9-4172-b309-7a9c2ad210f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ba316208ca44ddafd25b380bb1824a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:40Z,use_quota=True,user_id='e6894afebe3d48c384fed33f77d3847d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5021d87-01fa-484f-9cf6-0846dadf647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5021d87-01fa-484f-9cf6-0846dadf647c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd82b1da-ae00-452d-a3fe-acaa2459355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd82b1da-ae00-452d-a3fe-acaa2459355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ccc81ca-94e9-4172-b309-7a9c2ad210f4', 'volume_name': 'volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653a1e11-a53f-4fdd-9303-d98db27623fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653a1e11-a53f-4fdd-9303-d98db27623fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c688f26-ef3a-4672-bdc1-fe94e7cd04cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Volume 6ccc81ca-94e9-4172-b309-7a9c2ad210f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4', 'volume_size': 1} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:39 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.941s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-010d6798-f105-453f-91d0-e46ad3f9ed8a-59bc88cc-0ae9-4483-b051-ed376f3fc337" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-010d6798-f105-453f-91d0-e46ad3f9ed8a-59bc88cc-0ae9-4483-b051-ed376f3fc337" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Creating volume 59bc88cc-0ae9-4483-b051-ed376f3fc337 from snapshot 010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-59bc88cc-0ae9-4483-b051-ed376f3fc337" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9288f9f-bd62-47b0-ac9e-d8455718ddd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c029d5e-4ed9-4430-8960-b06834a7ada5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aefd730-46e3-4de4-9d6e-ac3444d16ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Volume volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 (7c029d5e-4ed9-4430-8960-b06834a7ada5): created successfully Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aefd730-46e3-4de4-9d6e-ac3444d16ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Flow 'volume_create_manager' (679a590f-0b7b-4545-b183-661c71efa7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-59bc88cc-0ae9-4483-b051-ed376f3fc337" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] snapshot: 010d6798-f105-453f-91d0-e46ad3f9ed8a, volume: 59bc88cc-0ae9-4483-b051-ed376f3fc337, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:14:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0613adae-aa31-4dba-9697-cae72fd4acf5 tempest-SnapshotDependencyTests-1129332819 None] Created volume successfully. Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8454204b-a3ac-48be-8af5-36a545a3a793]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:39 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a Apr 15 10:14:39 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:40 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a" returned: 0 in 0.597s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ed2be58-8586-419e-a35b-0164d8d6ab82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:14:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:14:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bedd033-8ce7-473f-acd2-1e153d42753e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:40 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 Apr 15 10:14:40 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:41 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82" returned: 0 in 0.650s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:41 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:14:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:41 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 Apr 15 10:14:41 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:43 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337" returned: 0 in 2.574s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:43 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3773bbd1-3489-4005-afd4-2a8a0950148b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:43 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 Apr 15 10:14:43 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:44 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82" returned: 0 in 0.666s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:14:44 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Converted 1024.00 MB image at 397.55 MB/s Apr 15 10:14:44 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 is being set with open permissions: ugo+rw Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:44 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 Apr 15 10:14:44 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:44 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337" returned: 0 in 0.557s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-59bc88cc-0ae9-4483-b051-ed376f3fc337" released by "_copy_volume_from_snapshot" :: held 5.118s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-010d6798-f105-453f-91d0-e46ad3f9ed8a-59bc88cc-0ae9-4483-b051-ed376f3fc337" released by "_create_volume_from_snapshot" :: held 5.158s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.172s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.263s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2051735526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccc81ca-94e9-4172-b309-7a9c2ad210f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ba316208ca44ddafd25b380bb1824a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:40Z,use_quota=True,user_id='e6894afebe3d48c384fed33f77d3847d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Creating volume 6ccc81ca-94e9-4172-b309-7a9c2ad210f4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:44 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:44 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 1073741824 Apr 15 10:14:44 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d559acf-13b5-4890-9e71-652f12c8c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bc88cc-0ae9-4483-b051-ed376f3fc337', 'volume_size': 1, 'snapshot_id': '010d6798-f105-453f-91d0-e46ad3f9ed8a'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6098e5e-06a9-416e-8a3f-e61eb0fae093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:44 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Volume volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 (59bc88cc-0ae9-4483-b051-ed376f3fc337): created successfully Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6098e5e-06a9-416e-8a3f-e61eb0fae093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Flow 'volume_create_manager' (06d4d387-8669-4d14-b045-ecd61b65ddac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-26d7b335-995b-47be-a4db-54d2624a3707 tempest-VolumesDeleteCascade-644994145 None] Created volume successfully. Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-8ed2be58-8586-419e-a35b-0164d8d6ab82-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-8ed2be58-8586-419e-a35b-0164d8d6ab82-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Performing cascade delete. {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-010d6798-f105-453f-91d0-e46ad3f9ed8a-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-010d6798-f105-453f-91d0-e46ad3f9ed8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-8ed2be58-8586-419e-a35b-0164d8d6ab82" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-8ed2be58-8586-419e-a35b-0164d8d6ab82" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-010d6798-f105-453f-91d0-e46ad3f9ed8a" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-010d6798-f105-453f-91d0-e46ad3f9ed8a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Deleting offline snapshot 010d6798-f105-453f-91d0-e46ad3f9ed8a of volume 8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] snapshot_file for this snap is: volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63c7bb-1b56-4ace-ad2a-85b1936e193a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:45 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a Apr 15 10:14:45 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:45 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 1073741824" returned: 0 in 0.685s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:45 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 Apr 15 10:14:45 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:46 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a" returned: 0 in 0.544s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ed2be58-8586-419e-a35b-0164d8d6ab82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41f43e4-6eda-45b5-b8f2-cbf623138ba2]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:46 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.189s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:46 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 Apr 15 10:14:46 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Creating offline snapshot 7ea5319a-d943-41e7-bdcd-8f0decf57987 of volume 7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c688f26-ef3a-4672-bdc1-fe94e7cd04cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35696ea-88a6-4058-ba35-509f7e584612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23866ff-aa60-4bd3-aead-6805247d028d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Volume volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 (6ccc81ca-94e9-4172-b309-7a9c2ad210f4): created successfully Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35696ea-88a6-4058-ba35-509f7e584612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Flow 'volume_create_manager' (43366a2e-23d9-470f-8556-9402f84e3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:46 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2816aa8c-1109-471c-8305-cfdb7611f9bd tempest-VolumesListTestJSON-900690288 None] Created volume successfully. Apr 15 10:14:46 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 Apr 15 10:14:46 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Flow 'volume_create_manager' (833f9693-dc8e-4e6e-be86-76713bc0f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e45afd-ed3a-4089-ac61-91e72910a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e45afd-ed3a-4089-ac61-91e72910a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1348738133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694ce197-2528-46e3-8ee6-75c47e502d19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ba316208ca44ddafd25b380bb1824a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:47Z,use_quota=True,user_id='e6894afebe3d48c384fed33f77d3847d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d82966-eadd-44b6-bc65-b22e0c1a338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d82966-eadd-44b6-bc65-b22e0c1a338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee9d65d-180c-47d1-933d-43ccaf4d3ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee9d65d-180c-47d1-933d-43ccaf4d3ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694ce197-2528-46e3-8ee6-75c47e502d19', 'volume_name': 'volume-694ce197-2528-46e3-8ee6-75c47e502d19', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad8281d-c7ab-4213-8693-90315ac09747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad8281d-c7ab-4213-8693-90315ac09747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827ef490-ea0d-46e0-a43a-ee4be99cb027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Volume 694ce197-2528-46e3-8ee6-75c47e502d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694ce197-2528-46e3-8ee6-75c47e502d19', 'volume_size': 1} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:46 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82" returned: 0 in 0.754s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:46 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a Apr 15 10:14:46 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:46 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5" returned: 0 in 0.667s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:46 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 1G Apr 15 10:14:46 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:47 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a" returned: 0 in 0.580s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:47 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a Apr 15 10:14:47 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:47 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 1G" returned: 0 in 0.643s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:47 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 Apr 15 10:14:47 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:47 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82.010d6798-f105-453f-91d0-e46ad3f9ed8a" returned: 0 in 0.431s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-010d6798-f105-453f-91d0-e46ad3f9ed8a" released by "_delete_snapshot" :: held 2.362s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-8ed2be58-8586-419e-a35b-0164d8d6ab82" released by "delete_snapshot" :: held 2.375s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Created reservations ['2005cf7e-88bd-4c66-a23e-f203044b85eb', '385581af-adc2-4ef5-acc8-8cc2275d9bc3', '8fc6b604-a94e-4730-903c-257d0cc8f4c2', 'ae7b0aa0-89ab-4cb3-8c65-9473374f5424'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Delete snapshot completed successfully. Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-010d6798-f105-453f-91d0-e46ad3f9ed8a-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Snapshots deleted, issuing volume delete {{(pid=82850) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-8ed2be58-8586-419e-a35b-0164d8d6ab82" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-8ed2be58-8586-419e-a35b-0164d8d6ab82" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e247eb42-e59d-4cc3-bd57-3a5cca8482d9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:48 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987" returned: 0 in 0.535s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:48 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 is being set with open permissions: ugo+rw Apr 15 10:14:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:48 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 Apr 15 10:14:48 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:48 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 Apr 15 10:14:48 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:48 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987" returned: 0 in 0.452s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-69cd22a0-eb93-4445-a84e-d5835d76f0f0 tempest-BackendsCapabilitiesAdminTestsJSON-1919074239 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7315406799316, 'free_capacity_gb': 1775.7315406799316, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82850) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 10:14:48 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.info Apr 15 10:14:48 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:48 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82" returned: 0 in 0.587s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:48 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82 Apr 15 10:14:48 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:49 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.info" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:49 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.info is being set with open permissions: ugo+rw Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:49 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.info Apr 15 10:14:49 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c6fdfa39-9b35-4209-a406-3a1aaa0be28f tempest-BackendsCapabilitiesAdminTestsJSON-1919074239 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7315406799316, 'free_capacity_gb': 1775.7315406799316, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82850) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 10:14:49 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ed2be58-8586-419e-a35b-0164d8d6ab82" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-8ed2be58-8586-419e-a35b-0164d8d6ab82" released by "delete_volume" :: held 1.140s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Created reservations ['8af87ead-32cf-4480-8dde-6b334a7289c9', '02350361-89e1-43ab-9219-2dde21bb8a2c', 'b5e50d25-5b0b-42e3-8570-dee25b535480', '7f68ad01-9c26-446d-9f52-19de59efa42a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:49 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:49 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:49 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.info" returned: 0 in 0.498s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.378s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.721s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1348738133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694ce197-2528-46e3-8ee6-75c47e502d19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8ba316208ca44ddafd25b380bb1824a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:47Z,use_quota=True,user_id='e6894afebe3d48c384fed33f77d3847d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Creating volume 694ce197-2528-46e3-8ee6-75c47e502d19 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:49 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:49 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 1073741824 Apr 15 10:14:49 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2c7ce96b-d3ff-4882-be35-2b676b0cdea9 tempest-SnapshotDependencyTests-1129332819 None] Create snapshot completed successfully Apr 15 10:14:49 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Deleted volume successfully. Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2b79ea6b-a91a-4ac7-85a2-aa50669b1241 tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-8ed2be58-8586-419e-a35b-0164d8d6ab82-delete_volume" released by "delete_volume" :: held 4.309s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-59bc88cc-0ae9-4483-b051-ed376f3fc337-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-59bc88cc-0ae9-4483-b051-ed376f3fc337-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "cinder-quobyte-59bc88cc-0ae9-4483-b051-ed376f3fc337" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-59bc88cc-0ae9-4483-b051-ed376f3fc337" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ed510-50f2-41da-8641-1f291df0db2e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:50 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 Apr 15 10:14:50 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:50 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 1073741824" returned: 0 in 0.642s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:50 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 Apr 15 10:14:50 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:50 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337" returned: 0 in 0.646s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:50 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337 Apr 15 10:14:50 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:50 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19" returned: 0 in 0.553s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827ef490-ea0d-46e0-a43a-ee4be99cb027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694ce197-2528-46e3-8ee6-75c47e502d19', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d465d26-5d03-4a32-b487-3953fa86ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:50 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Volume volume-694ce197-2528-46e3-8ee6-75c47e502d19 (694ce197-2528-46e3-8ee6-75c47e502d19): created successfully Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d465d26-5d03-4a32-b487-3953fa86ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Flow 'volume_create_manager' (833f9693-dc8e-4e6e-be86-76713bc0f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d4c0ba7d-7c26-4ad5-8854-8cb14affc169 tempest-VolumesListTestJSON-900690288 None] Created volume successfully. Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Flow 'volume_create_manager' (a5fca01b-f701-4b35-935c-62bfb5512c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cafa68-9822-45da-b6dd-ec1eec4eb489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6cafa68-9822-45da-b6dd-ec1eec4eb489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cced3a-99b3-444a-b095-f002ca4e11a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22439bc732a04a629b22462a3572320f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7ea5319a-d943-41e7-bdcd-8f0decf57987,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:51Z,use_quota=True,user_id='cd37bc2d968943e5bf368630d64b1be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c016c2b-aa39-4a2f-bdb2-eac2584ca21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c016c2b-aa39-4a2f-bdb2-eac2584ca21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce139328-b8a3-4fb0-8e26-02a5ad8c9e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce139328-b8a3-4fb0-8e26-02a5ad8c9e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12cced3a-99b3-444a-b095-f002ca4e11a0', 'volume_name': 'volume-12cced3a-99b3-444a-b095-f002ca4e11a0', 'volume_size': 1, 'snapshot_id': '7ea5319a-d943-41e7-bdcd-8f0decf57987'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3e8fdc-ffd6-4a93-8c52-67846449a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3e8fdc-ffd6-4a93-8c52-67846449a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d154685e-9594-4103-80e6-751c0ff94a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Volume 12cced3a-99b3-444a-b095-f002ca4e11a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12cced3a-99b3-444a-b095-f002ca4e11a0', 'volume_size': 1, 'snapshot_id': '7ea5319a-d943-41e7-bdcd-8f0decf57987'} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-quobyte-7ea5319a-d943-41e7-bdcd-8f0decf57987-12cced3a-99b3-444a-b095-f002ca4e11a0" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7ea5319a-d943-41e7-bdcd-8f0decf57987-12cced3a-99b3-444a-b095-f002ca4e11a0" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Creating volume 12cced3a-99b3-444a-b095-f002ca4e11a0 from snapshot 7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-quobyte-12cced3a-99b3-444a-b095-f002ca4e11a0" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-12cced3a-99b3-444a-b095-f002ca4e11a0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] snapshot: 7ea5319a-d943-41e7-bdcd-8f0decf57987, volume: 12cced3a-99b3-444a-b095-f002ca4e11a0, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e14ce2-44fc-4643-921a-ff7de898f1a1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:51 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 Apr 15 10:14:51 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:51 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-59bc88cc-0ae9-4483-b051-ed376f3fc337" returned: 0 in 0.597s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-quobyte-59bc88cc-0ae9-4483-b051-ed376f3fc337" released by "delete_volume" :: held 1.296s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Created reservations ['be2a0d2d-0498-4df4-92f3-3334ff331ca8', 'f741873e-f9ab-425c-a0a2-a3c3970d8f2d', 'cfc19f80-f48b-45b6-98fd-c4182b619d88', '531759f3-e7ce-444f-8815-4dbcb62b99e4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:51 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:51 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:51 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987" returned: 0 in 0.562s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c029d5e-4ed9-4430-8960-b06834a7ada5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4ab9c7-eadd-4f1a-ada0-b51040dd90a5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:51 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 Apr 15 10:14:51 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:52 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.674s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:52 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Deleted volume successfully. Apr 15 10:14:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad75b2ce-a103-467c-9c58-e0b540f2212e tempest-VolumesDeleteCascade-644994145 None] Lock "cinder-59bc88cc-0ae9-4483-b051-ed376f3fc337-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:52 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5" returned: 0 in 0.701s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:52 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:14:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:52 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 Apr 15 10:14:52 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "cinder-694ce197-2528-46e3-8ee6-75c47e502d19-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-694ce197-2528-46e3-8ee6-75c47e502d19-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:53 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=115,cinder:INSERT=43,cinder:UPDATE=146,cinder:DELETE=14 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:14:53 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=110,cinder:DELETE=12,cinder:INSERT=39,cinder:UPDATE=142 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:14:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "cinder-quobyte-694ce197-2528-46e3-8ee6-75c47e502d19" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-quobyte-694ce197-2528-46e3-8ee6-75c47e502d19" acquired by "delete_volume" :: waited 0.026s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02e5151-b7ca-4238-b5ab-87a9c64c80e9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:54 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 Apr 15 10:14:54 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:55 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0" returned: 0 in 2.836s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cc47bd-63d8-48ce-8c3a-a5ab0682e06f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:55 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 Apr 15 10:14:55 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4d3c2b49-8b3d-458d-943b-2749e3e5c8b4 tempest-GroupSnapshotsTest-36718485 None] Group tempest-GroupSnapshotsTest-Group-1598473169: creating Apr 15 10:14:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4d3c2b49-8b3d-458d-943b-2749e3e5c8b4 tempest-GroupSnapshotsTest-36718485 None] Group tempest-GroupSnapshotsTest-Group-1598473169: created successfully Apr 15 10:14:55 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4d3c2b49-8b3d-458d-943b-2749e3e5c8b4 tempest-GroupSnapshotsTest-36718485 None] Create group completed successfully. Apr 15 10:14:55 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19" returned: 0 in 1.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:55 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19 Apr 15 10:14:55 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Flow 'volume_create_manager' (cbe5b5c7-522a-42d4-a178-3f83209ed127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e5d6d1-0185-4602-a69d-9071d618b016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e5d6d1-0185-4602-a69d-9071d618b016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1151289164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089876b3-90cd-4cfd-a9dc-7113c18c46ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111af09dd6294a50973e86adead8989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:56Z,use_quota=True,user_id='5bfaf7db63ee48ed9fbee00a526bc095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf42193d-b536-448c-99e0-3d06154ae406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf42193d-b536-448c-99e0-3d06154ae406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67476e-4e6e-407f-8418-f751a502b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67476e-4e6e-407f-8418-f751a502b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '089876b3-90cd-4cfd-a9dc-7113c18c46ce', 'volume_name': 'volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ca5739-9622-4d78-8fc5-fe8a4ade4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ca5739-9622-4d78-8fc5-fe8a4ade4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2a1b2a-2554-4304-a85d-e5908f3158ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Volume 089876b3-90cd-4cfd-a9dc-7113c18c46ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce', 'volume_size': 1} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:55 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5" returned: 0 in 0.728s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5, size 1024.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:14:55 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Converted 1024.00 MB image at 360.94 MB/s Apr 15 10:14:55 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 is being set with open permissions: ugo+rw Apr 15 10:14:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:55 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 Apr 15 10:14:55 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:56 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-694ce197-2528-46e3-8ee6-75c47e502d19" returned: 0 in 0.514s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-quobyte-694ce197-2528-46e3-8ee6-75c47e502d19" released by "delete_volume" :: held 2.106s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Created reservations ['605aa17a-3247-4316-b66d-ffe4864c394d', 'a4075f35-d807-4bd0-8781-2b49bdb3fcaf', '9762369e-5a5e-4d93-bc1b-675d500ac89a', '9f0ff62e-d97c-47c4-a8e0-97c4f14b41e1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:56 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:56 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:56 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0" returned: 0 in 0.493s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-12cced3a-99b3-444a-b095-f002ca4e11a0" released by "_copy_volume_from_snapshot" :: held 5.396s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7ea5319a-d943-41e7-bdcd-8f0decf57987-12cced3a-99b3-444a-b095-f002ca4e11a0" released by "_create_volume_from_snapshot" :: held 5.421s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.430s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1151289164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=089876b3-90cd-4cfd-a9dc-7113c18c46ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111af09dd6294a50973e86adead8989d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:56Z,use_quota=True,user_id='5bfaf7db63ee48ed9fbee00a526bc095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Creating volume 089876b3-90cd-4cfd-a9dc-7113c18c46ce {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:56 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:56 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce 1073741824 Apr 15 10:14:56 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d154685e-9594-4103-80e6-751c0ff94a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12cced3a-99b3-444a-b095-f002ca4e11a0', 'volume_size': 1, 'snapshot_id': '7ea5319a-d943-41e7-bdcd-8f0decf57987'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872eae9f-c710-46e7-b72d-e3364553d5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Volume volume-12cced3a-99b3-444a-b095-f002ca4e11a0 (12cced3a-99b3-444a-b095-f002ca4e11a0): created successfully Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872eae9f-c710-46e7-b72d-e3364553d5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Flow 'volume_create_manager' (a5fca01b-f701-4b35-935c-62bfb5512c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-447b3ae3-8abf-4888-896c-77557c4469f0 tempest-SnapshotDependencyTests-1129332819 None] Created volume successfully. Apr 15 10:14:56 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Deleted volume successfully. Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e2f47ea0-5af3-4edf-9722-8c30762c3445 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-694ce197-2528-46e3-8ee6-75c47e502d19-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (c26e1bca-37f8-42e6-9d7a-38dc0d98b422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea1c2f7-58a3-4ff8-bce6-8a975012b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea1c2f7-58a3-4ff8-bce6-8a975012b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77117177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8413f149-eed4-432c-b5f8-c1054dd40250,host='devstack@QuobyteHD#QuobyteHD',id=252925ac-9cfb-405c-bc75-9bd86cd4c223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:57Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d76a3cc0-8f3c-49da-96c1-0943f0b5dac7),volume_type_id=d76a3cc0-8f3c-49da-96c1-0943f0b5dac7)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb30ad95-1712-4c00-9f08-e702c4f21d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb30ad95-1712-4c00-9f08-e702c4f21d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d34fac-b47e-41ee-b784-ca97a7eed20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d34fac-b47e-41ee-b784-ca97a7eed20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252925ac-9cfb-405c-bc75-9bd86cd4c223', 'volume_name': 'volume-252925ac-9cfb-405c-bc75-9bd86cd4c223', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b11f54-f95f-4e11-8e1d-44b958e8bbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b11f54-f95f-4e11-8e1d-44b958e8bbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a22ef0d-8620-4443-b187-f3c471d11309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:56 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Volume 252925ac-9cfb-405c-bc75-9bd86cd4c223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252925ac-9cfb-405c-bc75-9bd86cd4c223', 'volume_size': 1} Apr 15 10:14:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:57 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce 1073741824" returned: 0 in 0.604s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce Apr 15 10:14:57 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Acquiring lock "cinder-6ccc81ca-94e9-4172-b309-7a9c2ad210f4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Lock "cinder-6ccc81ca-94e9-4172-b309-7a9c2ad210f4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Acquiring lock "cinder-quobyte-6ccc81ca-94e9-4172-b309-7a9c2ad210f4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Lock "cinder-quobyte-6ccc81ca-94e9-4172-b309-7a9c2ad210f4" acquired by "delete_volume" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[195db996-d9f7-4431-b3c0-4d1e5b04aedb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 Apr 15 10:14:57 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-7ea5319a-d943-41e7-bdcd-8f0decf57987-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-7ea5319a-d943-41e7-bdcd-8f0decf57987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-quobyte-7c029d5e-4ed9-4430-8960-b06834a7ada5" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7c029d5e-4ed9-4430-8960-b06834a7ada5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-quobyte-7ea5319a-d943-41e7-bdcd-8f0decf57987" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7ea5319a-d943-41e7-bdcd-8f0decf57987" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Deleting offline snapshot 7ea5319a-d943-41e7-bdcd-8f0decf57987 of volume 7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] snapshot_file for this snap is: volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7291291b-4f6d-4f6a-a33c-05da14f0208b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 Apr 15 10:14:57 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce" returned: 0 in 0.528s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8413f149-eed4-432c-b5f8-c1054dd40250,created_at=2026-04-15T08:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77117177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8413f149-eed4-432c-b5f8-c1054dd40250,host='devstack@QuobyteHD#QuobyteHD',id=252925ac-9cfb-405c-bc75-9bd86cd4c223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:57Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d76a3cc0-8f3c-49da-96c1-0943f0b5dac7),volume_type_id=d76a3cc0-8f3c-49da-96c1-0943f0b5dac7)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Creating volume 252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:57 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2a1b2a-2554-4304-a85d-e5908f3158ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:57 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 1073741824 Apr 15 10:14:57 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1c2b49-c4d3-4b8e-ac37-74c9fd30464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Volume volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce (089876b3-90cd-4cfd-a9dc-7113c18c46ce): created successfully Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1c2b49-c4d3-4b8e-ac37-74c9fd30464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Flow 'volume_create_manager' (cbe5b5c7-522a-42d4-a178-3f83209ed127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b9fc6bc0-e0a5-4b62-bcd0-a3d78761f354 tempest-VolumesMetadataTest-1134894489 None] Created volume successfully. Apr 15 10:14:57 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4" returned: 0 in 0.572s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4 Apr 15 10:14:57 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987" returned: 0 in 0.672s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c029d5e-4ed9-4430-8960-b06834a7ada5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad64768-629e-4b91-8300-935cb930beea]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 Apr 15 10:14:58 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 1073741824" returned: 0 in 0.692s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 Apr 15 10:14:58 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6ccc81ca-94e9-4172-b309-7a9c2ad210f4" returned: 0 in 0.640s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Lock "cinder-quobyte-6ccc81ca-94e9-4172-b309-7a9c2ad210f4" released by "delete_volume" :: held 1.246s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Acquiring lock "cinder-089876b3-90cd-4cfd-a9dc-7113c18c46ce-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Lock "cinder-089876b3-90cd-4cfd-a9dc-7113c18c46ce-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Created reservations ['a95f551b-9863-43ab-b492-b063b1bc1e87', '40fc6b32-a968-44d0-bca9-68ac486e0372', '728cb5d3-be3c-4257-8ebc-22c5a38780ea', 'aacc4e50-b0b0-4ea4-a228-023d9aff437a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Acquiring lock "cinder-quobyte-089876b3-90cd-4cfd-a9dc-7113c18c46ce" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Lock "cinder-quobyte-089876b3-90cd-4cfd-a9dc-7113c18c46ce" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f7f7cc-ae46-4c8f-942b-45e537fdb1c2]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:58 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce Apr 15 10:14:58 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5" returned: 0 in 0.679s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 Apr 15 10:14:58 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223" returned: 0 in 0.672s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a22ef0d-8620-4443-b187-f3c471d11309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252925ac-9cfb-405c-bc75-9bd86cd4c223', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5d62b2-4590-4895-b9b8-683706e20fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:59 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Volume volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 (252925ac-9cfb-405c-bc75-9bd86cd4c223): created successfully Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5d62b2-4590-4895-b9b8-683706e20fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (c26e1bca-37f8-42e6-9d7a-38dc0d98b422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-254964b9-9384-4be1-8e15-de14eaf1bc70 tempest-GroupSnapshotsTest-36718485 None] Created volume successfully. Apr 15 10:14:59 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce" returned: 0 in 0.547s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:59 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce Apr 15 10:14:59 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.552s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:59 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Deleted volume successfully. Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ffc582fa-a094-4921-a525-5c517ee4150a tempest-VolumesListTestJSON-900690288 None] Lock "cinder-6ccc81ca-94e9-4172-b309-7a9c2ad210f4-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:59 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987" returned: 0 in 0.580s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:59 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987 Apr 15 10:14:59 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "cinder-826f3629-8e9a-499e-94c6-54362aa4e936-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-826f3629-8e9a-499e-94c6-54362aa4e936-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "cinder-quobyte-826f3629-8e9a-499e-94c6-54362aa4e936" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-quobyte-826f3629-8e9a-499e-94c6-54362aa4e936" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f22abc-d373-482b-b662-cced0c591930]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:59 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 Apr 15 10:14:59 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-089876b3-90cd-4cfd-a9dc-7113c18c46ce" returned: 0 in 0.539s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Lock "cinder-quobyte-089876b3-90cd-4cfd-a9dc-7113c18c46ce" released by "delete_volume" :: held 1.112s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Created reservations ['460db0c5-a631-40c1-b2a6-eeb4ca33f338', '90b4f569-de84-4fa1-8ca8-9ce59a4a6b7a', '6484fbbe-7b8e-436d-84ff-d4d9fa165be7', 'ba97ea43-3570-46a5-96e6-a81204ebf73a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:59 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:14:59 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5.7ea5319a-d943-41e7-bdcd-8f0decf57987" returned: 0 in 0.500s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7ea5319a-d943-41e7-bdcd-8f0decf57987" released by "_delete_snapshot" :: held 2.497s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7c029d5e-4ed9-4430-8960-b06834a7ada5" released by "delete_snapshot" :: held 2.513s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Created reservations ['3a82209d-ce20-4f03-8dfa-daf8a5ba5a92', 'b76e6f58-d094-414f-b0f9-8282297f25ca', 'fc6d7f8b-7215-4dcb-9038-5a0d0a191d56', '1cfdcb6c-7317-4c57-bfef-5114641fc098'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Delete snapshot completed successfully. Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-18baef1d-8913-4be9-8a36-656de8ad4a25 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-7ea5319a-d943-41e7-bdcd-8f0decf57987-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] GroupSnapshot 6effc3b8-edb9-4b43-b916-1889382dea9a: creating. Apr 15 10:15:00 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Group snapshot 6effc3b8-edb9-4b43-b916-1889382dea9a: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936" returned: 0 in 0.652s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Creating offline snapshot 976bdcaf-f171-4621-9bff-0cd0153a6a30 of volume 252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d62b1b9-7dfe-43cb-8c3a-19469c1be469]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:00 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936 Apr 15 10:15:00 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 Apr 15 10:15:00 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:00 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Deleted volume successfully. Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ffadb72-3967-44ea-91e2-5b8525daf758 tempest-VolumesMetadataTest-1134894489 None] Lock "cinder-089876b3-90cd-4cfd-a9dc-7113c18c46ce-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-7c029d5e-4ed9-4430-8960-b06834a7ada5-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-7c029d5e-4ed9-4430-8960-b06834a7ada5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-quobyte-7c029d5e-4ed9-4430-8960-b06834a7ada5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7c029d5e-4ed9-4430-8960-b06834a7ada5" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9550912-fd69-4d84-90da-77fd69a3f5ff]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-826f3629-8e9a-499e-94c6-54362aa4e936" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-quobyte-826f3629-8e9a-499e-94c6-54362aa4e936" released by "delete_volume" :: held 1.180s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 Apr 15 10:15:00 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Created reservations ['f70f141b-d171-45a6-bb28-713cf1ae361f', '7bb514c1-6811-47c8-a0aa-06f186a0b55f', '0774791c-3850-4bb4-a88d-8a933daab187', 'cfb7d96f-5005-4286-876d-ba891dfac0f0'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:00 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223" returned: 0 in 0.575s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:00 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 1G Apr 15 10:15:00 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5" returned: 0 in 0.605s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5 Apr 15 10:15:01 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.533s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Deleted volume successfully. Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-697826fc-1097-4276-bba8-36532f7736f5 tempest-VolumesListTestJSON-900690288 None] Lock "cinder-826f3629-8e9a-499e-94c6-54362aa4e936-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:01 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 1G" returned: 0 in 0.746s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 Apr 15 10:15:01 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7c029d5e-4ed9-4430-8960-b06834a7ada5" returned: 0 in 0.603s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-7c029d5e-4ed9-4430-8960-b06834a7ada5" released by "delete_volume" :: held 1.253s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Created reservations ['651ce021-3b5d-451c-a028-db58235f20f4', '42651b56-8b91-4240-9f6f-7eab2e995fc5', 'a41a09bb-d897-483f-87e4-05a0e25340c9', '6276895e-20e7-4c0d-823c-f2a1053c9b95'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:02 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:02 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:02 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30" returned: 0 in 0.702s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:02 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:02 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 Apr 15 10:15:02 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:02 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.601s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Deleted volume successfully. Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5c04a732-137a-4fbb-88b1-9aacab5221c9 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-7c029d5e-4ed9-4430-8960-b06834a7ada5-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-12cced3a-99b3-444a-b095-f002ca4e11a0-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-12cced3a-99b3-444a-b095-f002ca4e11a0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:02 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30" returned: 0 in 0.617s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "cinder-quobyte-12cced3a-99b3-444a-b095-f002ca4e11a0" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:03 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.info Apr 15 10:15:03 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-12cced3a-99b3-444a-b095-f002ca4e11a0" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[089e8399-bb5a-4472-bf9f-fbcb58a80838]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:03 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 Apr 15 10:15:03 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:03 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0" returned: 0 in 0.637s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:03 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0 Apr 15 10:15:03 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:03 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.info" returned: 0 in 0.761s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:03 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:15:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:03 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.info Apr 15 10:15:03 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:04 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-12cced3a-99b3-444a-b095-f002ca4e11a0" returned: 0 in 0.578s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-quobyte-12cced3a-99b3-444a-b095-f002ca4e11a0" released by "delete_volume" :: held 1.253s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Created reservations ['c2a9a489-8b04-463b-baa1-82f8cb405885', '3acd8962-aaa1-4775-9282-51a7e3b17868', '4932dc66-3a2f-4250-a6ee-61565273bd20', 'eca044e9-081d-4168-8ff0-f799b043246a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:04 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.info" returned: 0 in 0.687s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:04 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f82b0298-52b1-4a1c-bf5c-e03649fb6015 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 6effc3b8-edb9-4b43-b916-1889382dea9a: created successfully Apr 15 10:15:04 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.522s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Deleted volume successfully. Apr 15 10:15:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8ba0fec6-ae09-4a9b-b71d-aa9739c1f803 tempest-SnapshotDependencyTests-1129332819 None] Lock "cinder-12cced3a-99b3-444a-b095-f002ca4e11a0-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-976bdcaf-f171-4621-9bff-0cd0153a6a30-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-976bdcaf-f171-4621-9bff-0cd0153a6a30-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Creating volume 46c7f4ae-04c2-43fa-a01a-f6f45f31538c from snapshot 976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] snapshot: 976bdcaf-f171-4621-9bff-0cd0153a6a30, volume: 46c7f4ae-04c2-43fa-a01a-f6f45f31538c, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[767ca869-1978-4db1-817f-102bc14729ab]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:06 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 Apr 15 10:15:06 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:07 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30" returned: 0 in 0.787s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252925ac-9cfb-405c-bc75-9bd86cd4c223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:15:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:15:07 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c5800-be6d-4b6b-a381-7185c2b0b4c6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:07 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 Apr 15 10:15:07 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:08 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223" returned: 0 in 0.656s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:08 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:15:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:08 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c Apr 15 10:15:08 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:10 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" returned: 0 in 2.772s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea9fed-6464-4e0b-991b-f57420d690f3]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:10 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 Apr 15 10:15:10 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:11 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223" returned: 0 in 0.839s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:11 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223, size 1024.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:15:11 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Converted 1024.00 MB image at 369.30 MB/s Apr 15 10:15:11 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:15:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:11 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c Apr 15 10:15:11 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:12 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" returned: 0 in 0.540s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" released by "_copy_volume_from_snapshot" :: held 5.691s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-976bdcaf-f171-4621-9bff-0cd0153a6a30-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" released by "_create_volume_from_snapshot" :: held 5.719s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.732s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e304de44-fcf8-491e-9275-7e80f2f3551b tempest-GroupSnapshotsTest-36718485 None] Create group from source-snapshot-6effc3b8-edb9-4b43-b916-1889382dea9a completed successfully. Apr 15 10:15:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" acquired by "delete_volume" :: waited 0.035s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:13 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9824f656-c96c-48be-829d-64d9d49441e5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:13 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c Apr 15 10:15:13 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Flow 'volume_create_manager' (95ed8cce-b723-45df-88a8-18d8ec778264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a7478-e49e-46f6-b93e-52885d9e76d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a7478-e49e-46f6-b93e-52885d9e76d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206461063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a7693d-8305-4c03-9c11-15a23a63455c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6d7ebb7d11416aae12c42fe71b2e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:15Z,use_quota=True,user_id='03698b56c29c47848493b79f8c669975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a53353-f405-4fbc-b568-71fe8a418fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a53353-f405-4fbc-b568-71fe8a418fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca2e8b9-4bf8-488f-accb-e75f6c7c195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca2e8b9-4bf8-488f-accb-e75f6c7c195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a7693d-8305-4c03-9c11-15a23a63455c', 'volume_name': 'volume-d1a7693d-8305-4c03-9c11-15a23a63455c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159a5b7b-a2f8-4e36-8a63-7881a1e73228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159a5b7b-a2f8-4e36-8a63-7881a1e73228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa6ccdb-3329-4e06-8044-da0c7f6cc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Volume d1a7693d-8305-4c03-9c11-15a23a63455c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a7693d-8305-4c03-9c11-15a23a63455c', 'volume_size': 1} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-206461063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a7693d-8305-4c03-9c11-15a23a63455c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6d7ebb7d11416aae12c42fe71b2e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:15Z,use_quota=True,user_id='03698b56c29c47848493b79f8c669975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Creating volume d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:14 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" returned: 0 in 0.901s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:14 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c 1073741824 Apr 15 10:15:14 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:14 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c Apr 15 10:15:14 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:15 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" returned: 0 in 0.656s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-46c7f4ae-04c2-43fa-a01a-f6f45f31538c" released by "delete_volume" :: held 1.594s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['97761133-8a7e-4782-9e04-24f60c9e3b5a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:15 devstack cinder-volume[82850]: WARNING cinder.quota [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-49551689 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-49551689, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:15:15 devstack cinder-volume[82850]: WARNING cinder.quota [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-49551689 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-49551689, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['a8e03843-f454-4b69-9159-7b75f0683d97', '59259a92-14e0-48a1-bbfb-907fc55497af', '85cf1187-c982-40eb-ba69-ae4b41f6468a', '808c1fc3-830d-487c-8f9c-76a7502c2f34'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:15 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:15 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:15 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c 1073741824" returned: 0 in 1.002s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:15 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:15:15 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 6effc3b8-edb9-4b43-b916-1889382dea9a: deleting Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 6effc3b8-edb9-4b43-b916-1889382dea9a: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-252925ac-9cfb-405c-bc75-9bd86cd4c223" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-252925ac-9cfb-405c-bc75-9bd86cd4c223" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-976bdcaf-f171-4621-9bff-0cd0153a6a30" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-976bdcaf-f171-4621-9bff-0cd0153a6a30" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Deleting offline snapshot 976bdcaf-f171-4621-9bff-0cd0153a6a30 of volume 252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] snapshot_file for this snap is: volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab124fc-36fc-48db-9555-21445f5caba1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:16 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.713s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0bd6e371-db3c-4405-9707-a630f13ed5c0 tempest-GroupSnapshotsTest-36718485 None] Delete group completed successfully. Apr 15 10:15:16 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 Apr 15 10:15:16 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:16 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.726s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa6ccdb-3329-4e06-8044-da0c7f6cc554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a7693d-8305-4c03-9c11-15a23a63455c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2c1a5d-24c5-4ced-aee6-5d829e37987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Volume volume-d1a7693d-8305-4c03-9c11-15a23a63455c (d1a7693d-8305-4c03-9c11-15a23a63455c): created successfully Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2c1a5d-24c5-4ced-aee6-5d829e37987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Flow 'volume_create_manager' (95ed8cce-b723-45df-88a8-18d8ec778264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3839d228-6582-46f3-a4c5-6c471c17bcfe tempest-VolumesActionsTest-437002456 None] Created volume successfully. Apr 15 10:15:17 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30" returned: 0 in 0.882s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252925ac-9cfb-405c-bc75-9bd86cd4c223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1d10ed-af21-47ec-8d4a-12614f5fc560]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:17 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 Apr 15 10:15:17 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:17 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223" returned: 0 in 0.616s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:17 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 Apr 15 10:15:17 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:18 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30" returned: 0 in 0.639s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:18 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30 Apr 15 10:15:18 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:18 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223.976bdcaf-f171-4621-9bff-0cd0153a6a30" returned: 0 in 0.590s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-976bdcaf-f171-4621-9bff-0cd0153a6a30" released by "_delete_snapshot" :: held 2.795s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-252925ac-9cfb-405c-bc75-9bd86cd4c223" released by "delete_snapshot" :: held 2.814s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:18 devstack cinder-volume[82850]: WARNING cinder.quota [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-49551689 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-49551689, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:15:18 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['04d8db03-f234-499d-8655-0bb361ffb84d', 'f0a387de-d43f-4df3-91cd-ace37ff9d6d4', '084c2ba2-bb74-454c-934d-cbdae3c925e0', '5c45f603-c48d-42ab-a309-c9c2642c5dbe'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0b0f27c1-1fef-40e6-9427-7b445d65aec3 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 6effc3b8-edb9-4b43-b916-1889382dea9a: deleted successfully Apr 15 10:15:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-252925ac-9cfb-405c-bc75-9bd86cd4c223" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-252925ac-9cfb-405c-bc75-9bd86cd4c223" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e2715f-1f13-4f61-a23d-c2b57bdf92f6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:19 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 Apr 15 10:15:19 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:20 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223" returned: 0 in 0.666s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:20 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223 Apr 15 10:15:20 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:20 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-252925ac-9cfb-405c-bc75-9bd86cd4c223" returned: 0 in 0.643s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-252925ac-9cfb-405c-bc75-9bd86cd4c223" released by "delete_volume" :: held 1.368s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (f32d6da8-d83a-4abf-8537-cbd516752f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbee2ca-6a18-40b1-9878-b5bc56f3a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbee2ca-6a18-40b1-9878-b5bc56f3a012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1597981050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a665c-9c89-4fe5-af55-3731bcd2456d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:21Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d93787-77c0-483d-8481-b915eaaffb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d93787-77c0-483d-8481-b915eaaffb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a33760a-8b60-444c-86a3-b680d7e5bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a33760a-8b60-444c-86a3-b680d7e5bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5a665c-9c89-4fe5-af55-3731bcd2456d', 'volume_name': 'volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85eea7a-1ba6-4795-9b87-3fdfa604f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85eea7a-1ba6-4795-9b87-3fdfa604f988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15ae805-c14f-4801-8b4f-4ea256643ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Volume 4f5a665c-9c89-4fe5-af55-3731bcd2456d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d', 'volume_size': 1} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1597981050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a665c-9c89-4fe5-af55-3731bcd2456d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:21Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Creating volume 4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:21 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['4efcfd5e-41a6-4ae3-a37c-3c92a5b15931'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:21 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d 1073741824 Apr 15 10:15:21 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:21 devstack cinder-volume[82850]: WARNING cinder.db.sqlalchemy.api [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-49551689'] Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['bd68d336-85fa-4d78-8f9a-52fb94a303d7', '4dd2576d-4753-4d77-9b61-6ad9d494a0ed', '4afd4198-47cf-403e-8edb-4c90f03c1dc2', '3e6f6a5d-1aea-4baf-a75d-b765876d392e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:21 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:21 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:21 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d 1073741824" returned: 0 in 0.710s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:21 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d Apr 15 10:15:21 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:22 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.602s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e4648bc9-dca2-493d-9911-5bfb48b9be40 tempest-GroupSnapshotsTest-36718485 None] Delete group completed successfully. Apr 15 10:15:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-89b915c0-b0d4-4b33-a2c5-59892f22eb68 tempest-GroupSnapshotsTest-36718485 None] Group tempest-GroupSnapshotsTest-Group-1001126550: creating Apr 15 10:15:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-89b915c0-b0d4-4b33-a2c5-59892f22eb68 tempest-GroupSnapshotsTest-36718485 None] Group tempest-GroupSnapshotsTest-Group-1001126550: created successfully Apr 15 10:15:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-89b915c0-b0d4-4b33-a2c5-59892f22eb68 tempest-GroupSnapshotsTest-36718485 None] Create group completed successfully. Apr 15 10:15:22 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d" returned: 0 in 0.631s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15ae805-c14f-4801-8b4f-4ea256643ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169478a7-522d-4a50-9a59-2cf480fc751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Volume volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d (4f5a665c-9c89-4fe5-af55-3731bcd2456d): created successfully Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169478a7-522d-4a50-9a59-2cf480fc751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (f32d6da8-d83a-4abf-8537-cbd516752f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-38bd921c-17c0-4187-83c6-3f1b8473e7fe tempest-VolumesSnapshotTestJSON-163292371 None] Created volume successfully. Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Creating offline snapshot 3cbe0c2c-f052-4062-88db-369699fe299a of volume 4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f3a364-e457-4d46-9b62-281464bd08fc]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:23 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d Apr 15 10:15:23 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (9b78d700-7268-4b64-a0cc-2ce9aff677be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee36b072-efbb-4921-987d-f0d735dff9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee36b072-efbb-4921-987d-f0d735dff9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128495834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94034a9a-9eb0-4b37-b66e-c37dc8082c99,host='devstack@QuobyteHD#QuobyteHD',id=62b48af5-d966-48b7-87e1-19ea26e43791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:24Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2841760-a945-4f07-b776-8327ecafbe9e),volume_type_id=d2841760-a945-4f07-b776-8327ecafbe9e)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6f676e-2498-4852-b600-b5be142ecc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e6f676e-2498-4852-b600-b5be142ecc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39438ac-60eb-40e1-aff4-57ee470289d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39438ac-60eb-40e1-aff4-57ee470289d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b48af5-d966-48b7-87e1-19ea26e43791', 'volume_name': 'volume-62b48af5-d966-48b7-87e1-19ea26e43791', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de965ea0-afcb-4463-b397-559a7c04d795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de965ea0-afcb-4463-b397-559a7c04d795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07eb304-9359-4a2d-a7d1-55e247583309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Volume 62b48af5-d966-48b7-87e1-19ea26e43791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b48af5-d966-48b7-87e1-19ea26e43791', 'volume_size': 1} Apr 15 10:15:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:24 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d" returned: 0 in 0.603s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:24 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a 1G Apr 15 10:15:24 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:24 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a 1G" returned: 0 in 0.585s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:24 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a Apr 15 10:15:24 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:25 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:25 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a is being set with open permissions: ugo+rw Apr 15 10:15:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:25 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a Apr 15 10:15:25 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:25 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:25 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.info Apr 15 10:15:25 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:26 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.info" returned: 0 in 0.458s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:26 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.info is being set with open permissions: ugo+rw Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:26 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.info Apr 15 10:15:26 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:26 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.info" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.173s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94034a9a-9eb0-4b37-b66e-c37dc8082c99,created_at=2026-04-15T08:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-128495834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94034a9a-9eb0-4b37-b66e-c37dc8082c99,host='devstack@QuobyteHD#QuobyteHD',id=62b48af5-d966-48b7-87e1-19ea26e43791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:24Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2841760-a945-4f07-b776-8327ecafbe9e),volume_type_id=d2841760-a945-4f07-b776-8327ecafbe9e)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Creating volume 62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:26 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:15:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:26 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 1073741824 Apr 15 10:15:26 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c5758c15-7a08-416e-8989-463c8692933d tempest-VolumesSnapshotTestJSON-163292371 None] Create snapshot completed successfully Apr 15 10:15:27 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 1073741824" returned: 0 in 0.683s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:27 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 Apr 15 10:15:27 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-3cbe0c2c-f052-4062-88db-369699fe299a-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-3cbe0c2c-f052-4062-88db-369699fe299a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-4f5a665c-9c89-4fe5-af55-3731bcd2456d" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4f5a665c-9c89-4fe5-af55-3731bcd2456d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-3cbe0c2c-f052-4062-88db-369699fe299a" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-3cbe0c2c-f052-4062-88db-369699fe299a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Deleting offline snapshot 3cbe0c2c-f052-4062-88db-369699fe299a of volume 4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] snapshot_file for this snap is: volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4181189e-f0c8-473b-9f1f-49db1e4504b6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:27 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791" returned: 0 in 0.481s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07eb304-9359-4a2d-a7d1-55e247583309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b48af5-d966-48b7-87e1-19ea26e43791', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b37ccf0-f0b0-4018-b47a-6c2729c0e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Volume volume-62b48af5-d966-48b7-87e1-19ea26e43791 (62b48af5-d966-48b7-87e1-19ea26e43791): created successfully Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b37ccf0-f0b0-4018-b47a-6c2729c0e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (9b78d700-7268-4b64-a0cc-2ce9aff677be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:27 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a Apr 15 10:15:27 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ba8c464f-5c60-4abe-ac86-128c448c661a tempest-GroupSnapshotsTest-36718485 None] Created volume successfully. Apr 15 10:15:28 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a" returned: 0 in 0.555s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdc85e5-c41b-4d8b-8c88-1a15552cb3c0]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d Apr 15 10:15:28 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (23cb0aa4-be08-4f7c-800d-b0887a7dba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad83cad-0a9e-4020-8d9f-5f5e94daccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad83cad-0a9e-4020-8d9f-5f5e94daccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-162487977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94034a9a-9eb0-4b37-b66e-c37dc8082c99,host='devstack@QuobyteHD#QuobyteHD',id=a8a95891-1dfa-44fa-b15d-9874519322e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:29Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2841760-a945-4f07-b776-8327ecafbe9e),volume_type_id=d2841760-a945-4f07-b776-8327ecafbe9e)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b68d41f-4b10-4855-95e7-b72e67f91c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b68d41f-4b10-4855-95e7-b72e67f91c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd931ae7-237b-44d4-9861-acbef73f72d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd931ae7-237b-44d4-9861-acbef73f72d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a95891-1dfa-44fa-b15d-9874519322e4', 'volume_name': 'volume-a8a95891-1dfa-44fa-b15d-9874519322e4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa661a64-f7f9-48f7-9483-cc493bd1f4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa661a64-f7f9-48f7-9483-cc493bd1f4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6e2a8f-811d-4a8d-aeeb-8f3026ea6a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:28 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Volume a8a95891-1dfa-44fa-b15d-9874519322e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a95891-1dfa-44fa-b15d-9874519322e4', 'volume_size': 1} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94034a9a-9eb0-4b37-b66e-c37dc8082c99,created_at=2026-04-15T08:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-162487977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94034a9a-9eb0-4b37-b66e-c37dc8082c99,host='devstack@QuobyteHD#QuobyteHD',id=a8a95891-1dfa-44fa-b15d-9874519322e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:29Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2841760-a945-4f07-b776-8327ecafbe9e),volume_type_id=d2841760-a945-4f07-b776-8327ecafbe9e)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Creating volume a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:28 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 1073741824 Apr 15 10:15:28 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:28 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d" returned: 0 in 0.555s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a Apr 15 10:15:28 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 1073741824" returned: 0 in 0.559s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 Apr 15 10:15:29 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a" returned: 0 in 0.547s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a Apr 15 10:15:29 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4" returned: 0 in 0.529s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6e2a8f-811d-4a8d-aeeb-8f3026ea6a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a95891-1dfa-44fa-b15d-9874519322e4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164628e2-d959-4958-b99f-92c85ec54812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Volume volume-a8a95891-1dfa-44fa-b15d-9874519322e4 (a8a95891-1dfa-44fa-b15d-9874519322e4): created successfully Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164628e2-d959-4958-b99f-92c85ec54812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (23cb0aa4-be08-4f7c-800d-b0887a7dba45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-631e91e6-0eb9-45db-99df-12f49fcec74c tempest-GroupSnapshotsTest-36718485 None] Created volume successfully. Apr 15 10:15:30 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d.3cbe0c2c-f052-4062-88db-369699fe299a" returned: 0 in 0.486s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-3cbe0c2c-f052-4062-88db-369699fe299a" released by "_delete_snapshot" :: held 2.201s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4f5a665c-9c89-4fe5-af55-3731bcd2456d" released by "delete_snapshot" :: held 2.213s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:30 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['2fc0c3da-39a0-4f1f-a3e3-35c0407f547b', '6e289ab2-df40-4970-a21a-33ce0a955735', 'ff465f23-1283-412c-85c3-841f0bdcc497', '74d3a0d7-498e-46fa-a941-fd5debfd66e9'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Delete snapshot completed successfully. Apr 15 10:15:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9e81b2da-c120-4158-8957-d9b128b47bc2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-3cbe0c2c-f052-4062-88db-369699fe299a-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-04bab47e-2c4f-456e-9204-75adb23631c8 tempest-GroupSnapshotsTest-36718485 None] Update group completed successfully. Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (57c30300-b9af-442a-8377-65d670531f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b71d22-2193-40c7-821e-535c8b66c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b71d22-2193-40c7-821e-535c8b66c809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1673114408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b9fcd4-07f3-48a7-8c35-eeb667398a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:31Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df034fd8-c45f-4aec-b270-d9a8e04faba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df034fd8-c45f-4aec-b270-d9a8e04faba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181e1979-d67c-47c7-bfd2-91d62dda1875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181e1979-d67c-47c7-bfd2-91d62dda1875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b9fcd4-07f3-48a7-8c35-eeb667398a86', 'volume_name': 'volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e936deab-17df-4b5a-bc50-1199eb1fe42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e936deab-17df-4b5a-bc50-1199eb1fe42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af61c7f-0815-42a9-a16b-57cfd78e4d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:31 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Volume d6b9fcd4-07f3-48a7-8c35-eeb667398a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86', 'volume_size': 1} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1673114408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b9fcd4-07f3-48a7-8c35-eeb667398a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:31Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Creating volume d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:31 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 1073741824 Apr 15 10:15:31 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:31 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 1073741824" returned: 0 in 0.514s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 Apr 15 10:15:31 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1f9e0495-7f6f-4c5b-b112-3f1d134e49c6 tempest-GroupSnapshotsTest-36718485 None] Update group completed successfully. Apr 15 10:15:32 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" returned: 0 in 0.480s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af61c7f-0815-42a9-a16b-57cfd78e4d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59da1f98-21d6-4859-922f-f2ae3b750470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Volume volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 (d6b9fcd4-07f3-48a7-8c35-eeb667398a86): created successfully Apr 15 10:15:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59da1f98-21d6-4859-922f-f2ae3b750470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (57c30300-b9af-442a-8377-65d670531f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a08b2378-abab-4e6e-b5f2-f3bce639d096 tempest-VolumesSnapshotTestJSON-163292371 None] Created volume successfully. Apr 15 10:15:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9de19979-7d8c-47ae-9dda-f7a3f9ca6983 tempest-GroupSnapshotsTest-36718485 None] Update group completed successfully. Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:33 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Creating offline snapshot 75846c16-a73d-4ebd-8eb7-83c93e888759 of volume d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[35965eff-3f1b-4f05-9fac-f30cecfe7352]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 Apr 15 10:15:33 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:34 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" returned: 0 in 0.579s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 1G Apr 15 10:15:34 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7081db90-785f-44a9-8fc7-8681fe7256f2 tempest-GroupSnapshotsTest-36718485 None] Update group completed successfully. Apr 15 10:15:34 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 1G" returned: 0 in 0.563s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 Apr 15 10:15:34 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759" returned: 0 in 0.443s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 is being set with open permissions: ugo+rw Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 Apr 15 10:15:35 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8303fbb3-560b-4d90-95df-eee3ac0fc910 tempest-VolumesActionsTest-437002456 None] Acquiring lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c" by "attach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8303fbb3-560b-4d90-95df-eee3ac0fc910 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c" acquired by "attach_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8303fbb3-560b-4d90-95df-eee3ac0fc910 tempest-VolumesActionsTest-437002456 None] Attaching volume d1a7693d-8305-4c03-9c11-15a23a63455c to instance 5bfb98b4-0e19-4833-81e2-6b9f75c9ee3e at mountpoint /dev/vdb on host None. Apr 15 10:15:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8303fbb3-560b-4d90-95df-eee3ac0fc910 tempest-VolumesActionsTest-437002456 None] Attach volume completed successfully. Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8303fbb3-560b-4d90-95df-eee3ac0fc910 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c" released by "attach_volume" :: held 0.079s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] GroupSnapshot b6e041ae-e5b6-4f86-bb94-3a8109596234: creating. Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Group snapshot b6e041ae-e5b6-4f86-bb94-3a8109596234: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:35 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759" returned: 0 in 0.629s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.info Apr 15 10:15:35 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c4e51684-fb61-46b4-9856-7d6bb966b286 tempest-VolumesActionsTest-437002456 None] Acquiring lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c4e51684-fb61-46b4-9856-7d6bb966b286 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c4e51684-fb61-46b4-9856-7d6bb966b286 tempest-VolumesActionsTest-437002456 None] Detaching volume d1a7693d-8305-4c03-9c11-15a23a63455c from instance 5bfb98b4-0e19-4833-81e2-6b9f75c9ee3e. Apr 15 10:15:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c4e51684-fb61-46b4-9856-7d6bb966b286 tempest-VolumesActionsTest-437002456 None] Detach volume completed successfully. Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c4e51684-fb61-46b4-9856-7d6bb966b286 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:36 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.info" returned: 0 in 0.488s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.info is being set with open permissions: ugo+rw Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.info Apr 15 10:15:36 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.info" returned: 0 in 0.586s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.369s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.228s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Creating offline snapshot c55432e2-79a2-448b-a018-cbd9e6ce9654 of volume 62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e143bc7f-f560-4609-a9bc-36673e9a4bba tempest-VolumesSnapshotTestJSON-163292371 None] Create snapshot completed successfully Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b1499b-2e18-46d0-a346-a48e30687dc3]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 Apr 15 10:15:37 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 1G Apr 15 10:15:37 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 1G" returned: 0 in 0.846s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b48af5-d966-48b7-87e1-19ea26e43791 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:38 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b48af5-d966-48b7-87e1-19ea26e43791 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 Apr 15 10:15:38 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (162caab0-93fb-4a4a-bf27-fa34a67d988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e59d26-8e27-4fe5-8187-61f3e0d4e92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e59d26-8e27-4fe5-8187-61f3e0d4e92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1938292484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6867f5-2e29-402a-903c-f2983b272a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=75846c16-a73d-4ebd-8eb7-83c93e888759,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:38Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c86114a-17b2-4750-ba04-747e77b7f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c86114a-17b2-4750-ba04-747e77b7f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f313c5-1763-4a10-be45-47ceda3ada1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f313c5-1763-4a10-be45-47ceda3ada1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b6867f5-2e29-402a-903c-f2983b272a7e', 'volume_name': 'volume-6b6867f5-2e29-402a-903c-f2983b272a7e', 'volume_size': 2, 'snapshot_id': '75846c16-a73d-4ebd-8eb7-83c93e888759'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ccbb73-c82c-499e-b64f-d303ed4f7e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ccbb73-c82c-499e-b64f-d303ed4f7e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490cee8b-2b21-4840-af7b-ad03e51e0237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Volume 6b6867f5-2e29-402a-903c-f2983b272a7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b6867f5-2e29-402a-903c-f2983b272a7e', 'volume_size': 2, 'snapshot_id': '75846c16-a73d-4ebd-8eb7-83c93e888759'} Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:38 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62b48af5-d966-48b7-87e1-19ea26e43791 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654" returned: 0 in 0.609s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:15:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 Apr 15 10:15:39 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:39 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654" returned: 0 in 0.584s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.info Apr 15 10:15:39 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:40 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.info" returned: 0 in 0.513s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:40 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:40 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.info Apr 15 10:15:40 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:40 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.info" returned: 0 in 0.463s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.673s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Creating offline snapshot d18e4263-b122-4183-ad0a-2511ae4dbedb of volume a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9fa93-67d6-420a-9259-d3ce96c4f4f1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:40 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 Apr 15 10:15:40 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4" returned: 0 in 0.518s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb 1G Apr 15 10:15:41 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb 1G" returned: 0 in 0.553s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a95891-1dfa-44fa-b15d-9874519322e4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a95891-1dfa-44fa-b15d-9874519322e4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb Apr 15 10:15:41 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a95891-1dfa-44fa-b15d-9874519322e4 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb" returned: 0 in 0.489s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:15:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:42 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb Apr 15 10:15:42 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:42 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.info Apr 15 10:15:42 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:43 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.info" returned: 0 in 0.467s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.info Apr 15 10:15:43 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:43 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.info" returned: 0 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.974s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.056s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-75846c16-a73d-4ebd-8eb7-83c93e888759-6b6867f5-2e29-402a-903c-f2983b272a7e" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-75846c16-a73d-4ebd-8eb7-83c93e888759-6b6867f5-2e29-402a-903c-f2983b272a7e" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Creating volume 6b6867f5-2e29-402a-903c-f2983b272a7e from snapshot 75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-6b6867f5-2e29-402a-903c-f2983b272a7e" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-6b6867f5-2e29-402a-903c-f2983b272a7e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] snapshot: 75846c16-a73d-4ebd-8eb7-83c93e888759, volume: 6b6867f5-2e29-402a-903c-f2983b272a7e, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abe0b09-74a9-4e72-b9e4-a8490df0a20c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7540b43b-1582-41ba-b046-030060985acb tempest-GroupSnapshotsTest-36718485 None] group_snapshot b6e041ae-e5b6-4f86-bb94-3a8109596234: created successfully Apr 15 10:15:43 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 Apr 15 10:15:43 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] group_snapshot b6e041ae-e5b6-4f86-bb94-3a8109596234: deleting Apr 15 10:15:44 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] group_snapshot b6e041ae-e5b6-4f86-bb94-3a8109596234: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759" returned: 0 in 0.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-62b48af5-d966-48b7-87e1-19ea26e43791" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b0555-cac5-4eb6-a5f5-06e2bc0f7d15]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-62b48af5-d966-48b7-87e1-19ea26e43791" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-c55432e2-79a2-448b-a018-cbd9e6ce9654" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-c55432e2-79a2-448b-a018-cbd9e6ce9654" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Deleting offline snapshot c55432e2-79a2-448b-a018-cbd9e6ce9654 of volume 62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] snapshot_file for this snap is: volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8b4f36-a50a-4181-92f1-8a8fd58d7b10]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 Apr 15 10:15:44 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 Apr 15 10:15:44 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" returned: 0 in 0.584s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e Apr 15 10:15:44 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654" returned: 0 in 0.620s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62b48af5-d966-48b7-87e1-19ea26e43791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b2e065-cb0c-402e-aee4-428592c5d3b0]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 Apr 15 10:15:45 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:45 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791" returned: 0 in 0.750s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 Apr 15 10:15:45 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:47 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e" returned: 0 in 2.377s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4388d-8698-43ef-b5b9-270ee8c2bd84]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:47 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654" returned: 0 in 1.554s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:47 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654 Apr 15 10:15:47 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:47 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 Apr 15 10:15:47 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:47 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791.c55432e2-79a2-448b-a018-cbd9e6ce9654" returned: 0 in 0.458s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-c55432e2-79a2-448b-a018-cbd9e6ce9654" released by "_delete_snapshot" :: held 3.450s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-62b48af5-d966-48b7-87e1-19ea26e43791" released by "delete_snapshot" :: held 3.463s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-a8a95891-1dfa-44fa-b15d-9874519322e4" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-a8a95891-1dfa-44fa-b15d-9874519322e4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-d18e4263-b122-4183-ad0a-2511ae4dbedb" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-d18e4263-b122-4183-ad0a-2511ae4dbedb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Deleting offline snapshot d18e4263-b122-4183-ad0a-2511ae4dbedb of volume a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] snapshot_file for this snap is: volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd73350d-23f7-4b47-9a6d-21d8cf489ebf]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:47 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb Apr 15 10:15:47 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:47 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" returned: 0 in 0.671s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:15:47 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Converted 1024.00 MB image at 430.51 MB/s Apr 15 10:15:47 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e is being set with open permissions: ugo+rw Apr 15 10:15:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:47 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e Apr 15 10:15:47 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:48 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e" returned: 0 in 0.455s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-6b6867f5-2e29-402a-903c-f2983b272a7e" released by "_copy_volume_from_snapshot" :: held 4.717s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-75846c16-a73d-4ebd-8eb7-83c93e888759-6b6867f5-2e29-402a-903c-f2983b272a7e" released by "_create_volume_from_snapshot" :: held 4.747s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.769s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:48 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb" returned: 0 in 0.588s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8a95891-1dfa-44fa-b15d-9874519322e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490cee8b-2b21-4840-af7b-ad03e51e0237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6867f5-2e29-402a-903c-f2983b272a7e', 'volume_size': 2, 'snapshot_id': '75846c16-a73d-4ebd-8eb7-83c93e888759'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e671f-156a-4b9c-b305-e7dee4d5036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faad9e3-fb11-41ac-ab1a-a847d330403c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:48 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Volume volume-6b6867f5-2e29-402a-903c-f2983b272a7e (6b6867f5-2e29-402a-903c-f2983b272a7e): created successfully Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958e671f-156a-4b9c-b305-e7dee4d5036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (162caab0-93fb-4a4a-bf27-fa34a67d988c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2071e44e-9a57-491e-bf75-d1dbbc174681 tempest-VolumesSnapshotTestJSON-163292371 None] Created volume successfully. Apr 15 10:15:48 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 Apr 15 10:15:48 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:48 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4" returned: 0 in 0.518s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:48 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb Apr 15 10:15:48 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-6b6867f5-2e29-402a-903c-f2983b272a7e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-6b6867f5-2e29-402a-903c-f2983b272a7e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-6b6867f5-2e29-402a-903c-f2983b272a7e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-6b6867f5-2e29-402a-903c-f2983b272a7e" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3d3400-fa5b-41ef-b0cc-7045146c22d4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e Apr 15 10:15:49 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb" returned: 0 in 0.547s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb Apr 15 10:15:49 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e" returned: 0 in 0.587s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4.d18e4263-b122-4183-ad0a-2511ae4dbedb" returned: 0 in 0.442s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e Apr 15 10:15:49 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-d18e4263-b122-4183-ad0a-2511ae4dbedb" released by "_delete_snapshot" :: held 2.163s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-a8a95891-1dfa-44fa-b15d-9874519322e4" released by "delete_snapshot" :: held 2.181s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:49 devstack cinder-volume[82850]: WARNING cinder.quota [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-331813428 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-331813428, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:15:49 devstack cinder-volume[82850]: WARNING cinder.quota [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-331813428 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-331813428, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['9cfab72f-1390-4929-99a3-6e7bb6356e95', '1f4ebacc-8b5d-4a8c-a878-941226e449e0', '257c4f0a-45aa-43d7-99f8-f1a5bcd54160', 'f90065ea-6668-4749-94d3-f4de5145c270'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['6fd7549a-5030-4a20-850c-ee8863ad51f1', 'e4a44d9c-43fa-4506-9f96-97853803b1b1', 'b6323d1b-e166-43a3-a570-1baa18b25cca', '6104e3e8-8f76-4d2c-aeea-46db19943b62'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-67564245-b1fd-4f5e-adc1-1f145798f218 tempest-GroupSnapshotsTest-36718485 None] group_snapshot b6e041ae-e5b6-4f86-bb94-3a8109596234: deleted successfully Apr 15 10:15:50 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6b6867f5-2e29-402a-903c-f2983b272a7e" returned: 0 in 0.521s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-6b6867f5-2e29-402a-903c-f2983b272a7e" released by "delete_volume" :: held 1.135s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['03305dae-5ecd-427a-8f5a-4c5479c92d3f', '461156fc-1f2f-48e8-a93a-ce9110cc9fdf', '415b93fc-e7bf-4d96-b029-4647bfc1ad9a', 'd6d6a805-4869-4c13-a17a-21722fc7c61b'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:50 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:50 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-62b48af5-d966-48b7-87e1-19ea26e43791" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-62b48af5-d966-48b7-87e1-19ea26e43791" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9904b6a-9dad-418f-8682-a5ba24567924]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:51 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 Apr 15 10:15:51 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:51 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.551s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Deleted volume successfully. Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-47ed4a6c-db1a-4edc-be7e-e1240f8da53b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-6b6867f5-2e29-402a-903c-f2983b272a7e-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-75846c16-a73d-4ebd-8eb7-83c93e888759-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-75846c16-a73d-4ebd-8eb7-83c93e888759-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-75846c16-a73d-4ebd-8eb7-83c93e888759" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-75846c16-a73d-4ebd-8eb7-83c93e888759" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Deleting offline snapshot 75846c16-a73d-4ebd-8eb7-83c93e888759 of volume d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] snapshot_file for this snap is: volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a545992-fb8d-4757-b1b8-8625774899cb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:51 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791" returned: 0 in 0.649s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:51 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791 Apr 15 10:15:51 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:51 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 Apr 15 10:15:51 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-62b48af5-d966-48b7-87e1-19ea26e43791" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-62b48af5-d966-48b7-87e1-19ea26e43791" released by "delete_volume" :: held 1.187s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-a8a95891-1dfa-44fa-b15d-9874519322e4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-a8a95891-1dfa-44fa-b15d-9874519322e4" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae9f937-846f-48e4-955a-a135aa8a3dfa]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759" returned: 0 in 0.599s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a376277f-4091-4fd6-a926-fa2ef8abc9c0]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 Apr 15 10:15:52 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 Apr 15 10:15:52 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4" returned: 0 in 0.556s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" returned: 0 in 0.522s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4 Apr 15 10:15:52 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 Apr 15 10:15:52 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a8a95891-1dfa-44fa-b15d-9874519322e4" returned: 0 in 0.469s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-a8a95891-1dfa-44fa-b15d-9874519322e4" released by "delete_volume" :: held 1.072s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['88d33f4d-cf56-4de7-96af-7fd90cdd92a1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:53 devstack cinder-volume[82850]: WARNING cinder.quota [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-331813428 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-331813428, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['a461d305-57c4-4230-97c7-e9f26fed5e73', '3472c01d-b420-45b7-bb3e-27411b809aff', 'df6330e7-3f11-4366-89c3-e8c02a8e01c2', '319e2fe8-47a3-4682-9609-4d6e42c54873'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:53 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759" returned: 0 in 0.609s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759 Apr 15 10:15:53 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['eb5814d8-e191-4ab6-995f-55d64a0cd536', 'b33ac83b-b334-4b1c-9a63-b888fe9a4176', 'cd9c68a5-5b59-43a9-8fd9-962fa824ee93', '1fb777e6-7d14-4bc7-8a5a-51c64b379d1a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:53 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86.75846c16-a73d-4ebd-8eb7-83c93e888759" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-75846c16-a73d-4ebd-8eb7-83c93e888759" released by "_delete_snapshot" :: held 2.282s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" released by "delete_snapshot" :: held 2.296s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['6dc29d4c-baae-464d-974b-650c54d82ad2', '5275acb1-7ef1-4480-8f79-f20d868cd3a8', 'ef822e5a-44e8-4765-96ae-2187e4ae7209', 'ffe2034f-9bf8-4cda-9408-62633e7bdc90'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:53 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.445s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Delete snapshot completed successfully. Apr 15 10:15:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-230c6dc5-c807-4d05-a2e6-4ef1ff94ee19 tempest-GroupSnapshotsTest-36718485 None] Delete group completed successfully. Apr 15 10:15:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b879140d-c6c8-4067-bae7-8377361d0ea9 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-75846c16-a73d-4ebd-8eb7-83c93e888759-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=171,cinder:UPDATE=169,cinder:INSERT=38,cinder:DELETE=10 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:15:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7e04d8f2-6a0f-4c08-8f38-46441044a15f tempest-GroupSnapshotsTest-36718485 None] Group tempest-GroupSnapshotsTest-Group-148076897: creating Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=168,cinder:UPDATE=179,cinder:INSERT=47,cinder:DELETE=8 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:15:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7e04d8f2-6a0f-4c08-8f38-46441044a15f tempest-GroupSnapshotsTest-36718485 None] Group tempest-GroupSnapshotsTest-Group-148076897: created successfully Apr 15 10:15:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7e04d8f2-6a0f-4c08-8f38-46441044a15f tempest-GroupSnapshotsTest-36718485 None] Create group completed successfully. Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-d6b9fcd4-07f3-48a7-8c35-eeb667398a86-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-d6b9fcd4-07f3-48a7-8c35-eeb667398a86-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc4537c-ed6b-433c-b9ea-8eb55e257f9f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 Apr 15 10:15:54 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" returned: 0 in 0.504s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86 Apr 15 10:15:55 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" returned: 0 in 0.480s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-d6b9fcd4-07f3-48a7-8c35-eeb667398a86" released by "delete_volume" :: held 1.033s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['8d21d754-d817-4765-b68e-62d02950824c', '9b3669df-2a31-4ac3-b6a8-5075a1981b46', '24b6c323-d7e4-4c15-87c9-da2103bb06ea', '02a32914-c911-438f-9413-8837f2079616'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:55 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:15:55 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (f01314bd-f3c3-4f9c-93ab-7e7f7e1a61ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffde770-3472-4c9f-a0ef-d0eced894e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffde770-3472-4c9f-a0ef-d0eced894e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382417900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79438c0b-bfd4-4b32-800b-230601fafda2,host='devstack@QuobyteHD#QuobyteHD',id=0cc49840-8d86-4759-bc1d-53f8d41b614d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3eab3ed-1102-4d27-ac98-e688210f9b8f),volume_type_id=f3eab3ed-1102-4d27-ac98-e688210f9b8f)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725e3c1a-c9fd-4194-a905-7784b32e219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725e3c1a-c9fd-4194-a905-7784b32e219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e5b3bd-e683-4089-ad90-bacb24a67953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e5b3bd-e683-4089-ad90-bacb24a67953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc49840-8d86-4759-bc1d-53f8d41b614d', 'volume_name': 'volume-0cc49840-8d86-4759-bc1d-53f8d41b614d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0531add-9d68-4101-beb7-b36b55975f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0531add-9d68-4101-beb7-b36b55975f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2614b3-972c-4d38-a40d-d94945cc8921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Volume 0cc49840-8d86-4759-bc1d-53f8d41b614d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc49840-8d86-4759-bc1d-53f8d41b614d', 'volume_size': 1} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79438c0b-bfd4-4b32-800b-230601fafda2,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382417900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79438c0b-bfd4-4b32-800b-230601fafda2,host='devstack@QuobyteHD#QuobyteHD',id=0cc49840-8d86-4759-bc1d-53f8d41b614d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b32b01854c4ae585fa713bc5ad2e7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='d784802e37344cfdaf76887bbe5826f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3eab3ed-1102-4d27-ac98-e688210f9b8f),volume_type_id=f3eab3ed-1102-4d27-ac98-e688210f9b8f)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Creating volume 0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:55 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:15:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d 1073741824 Apr 15 10:15:56 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.667s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Deleted volume successfully. Apr 15 10:15:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e0838247-21a7-4816-b40e-8f663734deb6 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-d6b9fcd4-07f3-48a7-8c35-eeb667398a86-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:56 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d 1073741824" returned: 0 in 0.770s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d Apr 15 10:15:56 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:57 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d" returned: 0 in 0.499s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2614b3-972c-4d38-a40d-d94945cc8921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc49840-8d86-4759-bc1d-53f8d41b614d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01243404-2b89-49d5-8ec6-b026da36d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Volume volume-0cc49840-8d86-4759-bc1d-53f8d41b614d (0cc49840-8d86-4759-bc1d-53f8d41b614d): created successfully Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01243404-2b89-49d5-8ec6-b026da36d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Flow 'volume_create_manager' (f01314bd-f3c3-4f9c-93ab-7e7f7e1a61ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (ed498b92-23fa-4319-b128-fb5cb32b19b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0c3194-83dc-41c7-aef8-ddac4eebe087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fca7bdff-76c5-4a9c-b75a-61bd6eba98e8 tempest-GroupSnapshotsTest-36718485 None] Created volume successfully. Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0c3194-83dc-41c7-aef8-ddac4eebe087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1776037327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd3388e-384a-4ace-aee1-b2d739b71c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd836db3-2b04-4a0f-80b9-5552e1514410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd836db3-2b04-4a0f-80b9-5552e1514410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2181865e-5bf8-48f5-a340-7b27026893eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2181865e-5bf8-48f5-a340-7b27026893eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd3388e-384a-4ace-aee1-b2d739b71c22', 'volume_name': 'volume-4cd3388e-384a-4ace-aee1-b2d739b71c22', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d67e669-0632-4195-b464-885d2da5356e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d67e669-0632-4195-b464-885d2da5356e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08791e16-9a86-438d-8033-f16186c6e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:57 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Volume 4cd3388e-384a-4ace-aee1-b2d739b71c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd3388e-384a-4ace-aee1-b2d739b71c22', 'volume_size': 1} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1776037327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd3388e-384a-4ace-aee1-b2d739b71c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Creating volume 4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:57 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:15:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 1073741824 Apr 15 10:15:57 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 1073741824" returned: 0 in 0.588s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 Apr 15 10:15:58 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1964e2d-eb69-4efe-afbd-eb5c08d92419 tempest-VolumesActionsTest-437002456 None] Acquiring lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c" by "attach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1964e2d-eb69-4efe-afbd-eb5c08d92419 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c" acquired by "attach_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] GroupSnapshot 5864b5ab-d132-4ca6-b395-4b87fedd697a: creating. Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Group snapshot 5864b5ab-d132-4ca6-b395-4b87fedd697a: creating. {{(pid=82850) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:15:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c1964e2d-eb69-4efe-afbd-eb5c08d92419 tempest-VolumesActionsTest-437002456 None] Attaching volume d1a7693d-8305-4c03-9c11-15a23a63455c to instance 9d0a0c9e-25b8-4864-9657-8a98e7a972bc at mountpoint /dev/vdb on host None. Apr 15 10:15:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c1964e2d-eb69-4efe-afbd-eb5c08d92419 tempest-VolumesActionsTest-437002456 None] Attach volume completed successfully. Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c1964e2d-eb69-4efe-afbd-eb5c08d92419 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c" released by "attach_volume" :: held 0.159s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:58 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22" returned: 0 in 0.528s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.209s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Creating offline snapshot 9c82a516-978c-412c-88e5-92834881d310 of volume 0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08791e16-9a86-438d-8033-f16186c6e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd3388e-384a-4ace-aee1-b2d739b71c22', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fe24bc-2559-4497-9626-35077de58b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[055bc680-c529-47e2-9ddd-474f5a1f80c6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Volume volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 (4cd3388e-384a-4ace-aee1-b2d739b71c22): created successfully Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fe24bc-2559-4497-9626-35077de58b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (ed498b92-23fa-4319-b128-fb5cb32b19b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-51c83942-545f-4c59-addd-5409820f0bf8 tempest-VolumesSnapshotTestJSON-163292371 None] Created volume successfully. Apr 15 10:15:58 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d Apr 15 10:15:58 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f806264-4e1f-4d31-b618-54389e6e7236 tempest-VolumesActionsTest-437002456 None] Acquiring lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-detach_volume" by "detach_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f806264-4e1f-4d31-b618-54389e6e7236 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0f806264-4e1f-4d31-b618-54389e6e7236 tempest-VolumesActionsTest-437002456 None] Detaching volume d1a7693d-8305-4c03-9c11-15a23a63455c from instance 9d0a0c9e-25b8-4864-9657-8a98e7a972bc. Apr 15 10:15:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0f806264-4e1f-4d31-b618-54389e6e7236 tempest-VolumesActionsTest-437002456 None] Detach volume completed successfully. Apr 15 10:15:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f806264-4e1f-4d31-b618-54389e6e7236 tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:59 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d" returned: 0 in 0.526s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 1G Apr 15 10:15:59 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:59 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 1G" returned: 0 in 0.687s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc49840-8d86-4759-bc1d-53f8d41b614d -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc49840-8d86-4759-bc1d-53f8d41b614d -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 Apr 15 10:15:59 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc49840-8d86-4759-bc1d-53f8d41b614d -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310" returned: 0 in 0.445s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:16:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 Apr 15 10:16:00 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.info Apr 15 10:16:00 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.info" returned: 0 in 0.527s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.info Apr 15 10:16:01 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.info" returned: 0 in 0.450s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.059s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Creating offline snapshot ee6696c6-ba9d-4fbf-8f90-993d0805936c of volume 4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd45ea3a-b558-4aff-b77c-1daaa6dfcbc5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0212fd2e-a0aa-4945-9fde-0ff12593ef68 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 5864b5ab-d132-4ca6-b395-4b87fedd697a: created successfully Apr 15 10:16:01 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 Apr 15 10:16:01 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:02 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22" returned: 0 in 0.540s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:02 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c 1G Apr 15 10:16:02 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 5864b5ab-d132-4ca6-b395-4b87fedd697a: deleting Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 5864b5ab-d132-4ca6-b395-4b87fedd697a: deleting {{(pid=82850) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-0cc49840-8d86-4759-bc1d-53f8d41b614d" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-0cc49840-8d86-4759-bc1d-53f8d41b614d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-9c82a516-978c-412c-88e5-92834881d310" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-9c82a516-978c-412c-88e5-92834881d310" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Deleting offline snapshot 9c82a516-978c-412c-88e5-92834881d310 of volume 0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] snapshot_file for this snap is: volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[37393c94-300c-4f10-bc24-6aa4be7f5c08]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:02 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 Apr 15 10:16:02 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c 1G" returned: 0 in 0.655s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c Apr 15 10:16:03 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310" returned: 0 in 0.514s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc49840-8d86-4759-bc1d-53f8d41b614d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf9df15-62a2-4f02-a856-c8e56f5fb91f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d Apr 15 10:16:03 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c" returned: 0 in 0.534s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c is being set with open permissions: ugo+rw Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c Apr 15 10:16:03 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d" returned: 0 in 0.540s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 Apr 15 10:16:03 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c" returned: 0 in 0.443s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.info Apr 15 10:16:04 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310" returned: 0 in 0.500s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310 Apr 15 10:16:04 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.info" returned: 0 in 0.442s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.info is being set with open permissions: ugo+rw Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.info Apr 15 10:16:04 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d.9c82a516-978c-412c-88e5-92834881d310" returned: 0 in 0.461s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-9c82a516-978c-412c-88e5-92834881d310" released by "_delete_snapshot" :: held 2.094s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-0cc49840-8d86-4759-bc1d-53f8d41b614d" released by "delete_snapshot" :: held 2.106s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:04 devstack cinder-volume[82850]: WARNING cinder.quota [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-70529370 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-70529370, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:16:04 devstack cinder-volume[82850]: WARNING cinder.quota [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-70529370 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-70529370, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['d1c12816-e82e-48f2-bfcb-968fd2ba698e', 'cde9df9a-b16f-47f2-8e60-9c2ae78f4640', '7fe4bc89-812a-43ee-9c8d-19956e0da71b', 'dd4d0e27-6fd6-4ec0-b57d-3ca696adec7e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e5fecd21-554c-4065-abda-ab16685012f6 tempest-GroupSnapshotsTest-36718485 None] group_snapshot 5864b5ab-d132-4ca6-b395-4b87fedd697a: deleted successfully Apr 15 10:16:04 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.info" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.165s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:04 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ff600e89-d3ce-4a3c-9409-a300f6ddc1b2 tempest-VolumesSnapshotTestJSON-163292371 None] Create snapshot completed successfully Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "cinder-quobyte-0cc49840-8d86-4759-bc1d-53f8d41b614d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-0cc49840-8d86-4759-bc1d-53f8d41b614d" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c9d8e9-c6a8-44a7-9ed2-fed29f5dcf5a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:06 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d Apr 15 10:16:06 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (d57b242c-775b-4add-a720-17635bbb7786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccaee0e-8978-45a7-a547-68c229de7988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccaee0e-8978-45a7-a547-68c229de7988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1630377172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2110768b-7313-4b7f-9651-9792fb5d58a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b538f909a781444faf23cbcfee94be8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee6696c6-ba9d-4fbf-8f90-993d0805936c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:06Z,use_quota=True,user_id='332538d3eb024416b6499b3c7d0c85aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2090fc64-7016-474d-8499-2496fe4c5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2090fc64-7016-474d-8499-2496fe4c5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d0718a-2e72-4381-a06a-e6124dfef273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d0718a-2e72-4381-a06a-e6124dfef273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2110768b-7313-4b7f-9651-9792fb5d58a2', 'volume_name': 'volume-2110768b-7313-4b7f-9651-9792fb5d58a2', 'volume_size': 1, 'snapshot_id': 'ee6696c6-ba9d-4fbf-8f90-993d0805936c'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363aaf0-2d63-40b8-9e84-788bb11ace51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363aaf0-2d63-40b8-9e84-788bb11ace51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73c6efe-6e87-4bc4-918a-bb1ce405afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:06 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Volume 2110768b-7313-4b7f-9651-9792fb5d58a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2110768b-7313-4b7f-9651-9792fb5d58a2', 'volume_size': 1, 'snapshot_id': 'ee6696c6-ba9d-4fbf-8f90-993d0805936c'} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-ee6696c6-ba9d-4fbf-8f90-993d0805936c-2110768b-7313-4b7f-9651-9792fb5d58a2" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-ee6696c6-ba9d-4fbf-8f90-993d0805936c-2110768b-7313-4b7f-9651-9792fb5d58a2" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Creating volume 2110768b-7313-4b7f-9651-9792fb5d58a2 from snapshot ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-2110768b-7313-4b7f-9651-9792fb5d58a2" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-2110768b-7313-4b7f-9651-9792fb5d58a2" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] snapshot: ee6696c6-ba9d-4fbf-8f90-993d0805936c, volume: 2110768b-7313-4b7f-9651-9792fb5d58a2, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f388e30c-540e-407b-b534-297aaca459c6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:06 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c Apr 15 10:16:06 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:06 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d" returned: 0 in 0.619s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:06 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d Apr 15 10:16:06 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:07 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c" returned: 0 in 0.619s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd3388e-384a-4ace-aee1-b2d739b71c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ee37a-e737-4a35-9f49-68f400d2ff20]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:07 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 Apr 15 10:16:07 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:07 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0cc49840-8d86-4759-bc1d-53f8d41b614d" returned: 0 in 0.616s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Lock "cinder-quobyte-0cc49840-8d86-4759-bc1d-53f8d41b614d" released by "delete_volume" :: held 1.300s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['a2303765-3902-43ab-b44d-5ccaa4acd582'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:07 devstack cinder-volume[82850]: WARNING cinder.quota [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-70529370 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-70529370, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Created reservations ['60f98fb5-fe3b-473b-94b8-4dd6eb6493d0', 'ef907b45-d776-4013-83d4-18b8842825da', '87437134-e583-4cac-9862-917462663342', '6e3ffece-cd0a-4f46-b435-9762720633bf'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:07 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:07 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:07 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22" returned: 0 in 0.602s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:16:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:07 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 Apr 15 10:16:07 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:08 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.508s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:08 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-79ec9883-c92e-455e-b77b-6b476a039309 tempest-GroupSnapshotsTest-36718485 None] Delete group completed successfully. Apr 15 10:16:10 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2" returned: 0 in 2.288s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8ad21f-8399-4e29-a587-e9f79e2fc7b4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 Apr 15 10:16:10 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22" returned: 0 in 0.740s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:10 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Converted 1024.00 MB image at 447.24 MB/s Apr 15 10:16:10 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 is being set with open permissions: ugo+rw Apr 15 10:16:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 Apr 15 10:16:10 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2" returned: 0 in 0.564s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-2110768b-7313-4b7f-9651-9792fb5d58a2" released by "_copy_volume_from_snapshot" :: held 4.890s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-ee6696c6-ba9d-4fbf-8f90-993d0805936c-2110768b-7313-4b7f-9651-9792fb5d58a2" released by "_create_volume_from_snapshot" :: held 4.909s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.919s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.267s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e9c2d-41ba-47fe-9d6c-1f39fe729155]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73c6efe-6e87-4bc4-918a-bb1ce405afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2110768b-7313-4b7f-9651-9792fb5d58a2', 'volume_size': 1, 'snapshot_id': 'ee6696c6-ba9d-4fbf-8f90-993d0805936c'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d2cd0f-6a01-4708-a36c-f04bf85ac980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:11 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Volume volume-2110768b-7313-4b7f-9651-9792fb5d58a2 (2110768b-7313-4b7f-9651-9792fb5d58a2): created successfully Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d2cd0f-6a01-4708-a36c-f04bf85ac980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Flow 'volume_create_manager' (d57b242c-775b-4add-a720-17635bbb7786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4b931c7e-fdde-4e07-98be-85547dc2590b tempest-VolumesSnapshotTestJSON-163292371 None] Created volume successfully. Apr 15 10:16:11 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:11 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-2110768b-7313-4b7f-9651-9792fb5d58a2-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-2110768b-7313-4b7f-9651-9792fb5d58a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:11 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-2110768b-7313-4b7f-9651-9792fb5d58a2" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.601s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-2110768b-7313-4b7f-9651-9792fb5d58a2" acquired by "delete_volume" :: waited 0.019s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa5a03a-4bd6-4a07-b59b-ea74090a8c76]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a76852f-c220-43b0-bf8f-ac03e2442348]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:12 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 Apr 15 10:16:12 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.594s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.3f0ac946-0e0c-4898-89cb-be0970c32ce5mo3l3xe_.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.3f0ac946-0e0c-4898-89cb-be0970c32ce5mo3l3xe_.img Apr 15 10:16:12 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2" returned: 0 in 0.616s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2 Apr 15 10:16:12 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Flow 'volume_create_manager' (ad2565b2-04ed-4721-8b77-076670a82248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bbe346-6589-4de1-9bab-29af8c09eb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bbe346-6589-4de1-9bab-29af8c09eb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1216201324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f157701-8780-4ff3-937d-3d0d5ca8a107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d9262a4254a518aaa5b3b3f30bf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:13Z,use_quota=True,user_id='e06b6527052a40619af155b02084bd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d088e0-53c8-4655-9c4e-0ab641536254),volume_type_id=28d088e0-53c8-4655-9c4e-0ab641536254)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019e3b2a-6693-4c82-9495-bdef07d369ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019e3b2a-6693-4c82-9495-bdef07d369ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55eaf7ff-fc9f-4340-bb6c-41725bb3fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55eaf7ff-fc9f-4340-bb6c-41725bb3fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f157701-8780-4ff3-937d-3d0d5ca8a107', 'volume_name': 'volume-8f157701-8780-4ff3-937d-3d0d5ca8a107', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbc7468-6b17-4246-bbf0-c3cd3dfc2002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbc7468-6b17-4246-bbf0-c3cd3dfc2002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4235713-d009-441a-a646-a3f28610c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Volume 8f157701-8780-4ff3-937d-3d0d5ca8a107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f157701-8780-4ff3-937d-3d0d5ca8a107', 'volume_size': 1} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:13 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2110768b-7313-4b7f-9651-9792fb5d58a2" returned: 0 in 0.759s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-2110768b-7313-4b7f-9651-9792fb5d58a2" released by "delete_volume" :: held 1.424s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['8a4d45ac-b9dd-4f28-b9df-f121b1a0e1ca', '27442d1c-01ca-4b20-aa59-cb4d9c1cbf19', '345684ce-21d1-48e2-81f8-bd5a6ea69bb9', '4e06de9e-b200-4614-88fa-69b23c368574'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:13 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-ee6696c6-ba9d-4fbf-8f90-993d0805936c-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-ee6696c6-ba9d-4fbf-8f90-993d0805936c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-4cd3388e-384a-4ace-aee1-b2d739b71c22" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4cd3388e-384a-4ace-aee1-b2d739b71c22" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-ee6696c6-ba9d-4fbf-8f90-993d0805936c" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-ee6696c6-ba9d-4fbf-8f90-993d0805936c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Deleting offline snapshot ee6696c6-ba9d-4fbf-8f90-993d0805936c of volume 4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] snapshot_file for this snap is: volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7accaf7b-fbe5-462b-a657-6badc3529716]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c Apr 15 10:16:14 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.3f0ac946-0e0c-4898-89cb-be0970c32ce5mo3l3xe_.img" returned: 0 in 2.287s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a461477-5bf1-4bcc-a3c0-c46073553ec6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 1.189s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Deleted volume successfully. Apr 15 10:16:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faf0aca8-3985-4c64-ba78-4103a507f28c tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-2110768b-7313-4b7f-9651-9792fb5d58a2-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:14 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:14 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:15 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c" returned: 0 in 0.613s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd3388e-384a-4ace-aee1-b2d739b71c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d6aaeb-4497-49a6-8b33-d371ce187a4d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 Apr 15 10:16:15 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:15 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.653s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.3f0ac946-0e0c-4898-89cb-be0970c32ce5mo3l3xe_.img {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:15 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Converted 1024.00 MB image at 447.30 MB/s Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] 3f0ac946-0e0c-4898-89cb-be0970c32ce5 was raw, no need to convert to raw {{(pid=82850) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 10:16:15 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22" returned: 0 in 0.538s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c Apr 15 10:16:15 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c" returned: 0 in 0.565s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:16 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c Apr 15 10:16:16 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22.ee6696c6-ba9d-4fbf-8f90-993d0805936c" returned: 0 in 0.523s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-ee6696c6-ba9d-4fbf-8f90-993d0805936c" released by "_delete_snapshot" :: held 2.347s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4cd3388e-384a-4ace-aee1-b2d739b71c22" released by "delete_snapshot" :: held 2.374s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['8aa50f91-6ec7-4f3e-87f1-018a057f2935', '8ad3e92f-51c9-4246-980b-07edd1956e72', '8e54082d-398c-48d8-9e1a-88f6b7e46c9f', '550b58d1-e114-4430-821e-fef5c1c70df7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Delete snapshot completed successfully. Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4c568284-b765-435f-a5c2-d9ad906372f2 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-ee6696c6-ba9d-4fbf-8f90-993d0805936c-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-4cd3388e-384a-4ace-aee1-b2d739b71c22-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-4cd3388e-384a-4ace-aee1-b2d739b71c22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-4cd3388e-384a-4ace-aee1-b2d739b71c22" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4cd3388e-384a-4ace-aee1-b2d739b71c22" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfcf881-28bb-4c99-a104-69a894592482]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:17 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 Apr 15 10:16:17 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:18 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22" returned: 0 in 0.583s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:18 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22 Apr 15 10:16:18 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:19 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4cd3388e-384a-4ace-aee1-b2d739b71c22" returned: 0 in 0.508s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4cd3388e-384a-4ace-aee1-b2d739b71c22" released by "delete_volume" :: held 1.134s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['d92d7692-39fd-41e1-987a-f99fbf1e3f15', 'ddc63b61-8cfd-49a6-8dee-4a0db00a43c3', '1edc04ae-719c-4148-9b7c-f8c2ec263f02', '99d68308-b35d-4f89-8cfc-6f59ad05fd33'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:19 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:19 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:19 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Deleted volume successfully. Apr 15 10:16:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-30d868ae-b6bd-44d5-8c81-d3fea5756c4e tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-4cd3388e-384a-4ace-aee1-b2d739b71c22-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-4f5a665c-9c89-4fe5-af55-3731bcd2456d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-4f5a665c-9c89-4fe5-af55-3731bcd2456d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "cinder-quobyte-4f5a665c-9c89-4fe5-af55-3731bcd2456d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4f5a665c-9c89-4fe5-af55-3731bcd2456d" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a929db2-f5ba-4339-9d1f-d748e246b011]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:20 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d Apr 15 10:16:20 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:20 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d" returned: 0 in 0.535s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:20 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d Apr 15 10:16:20 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:21 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4f5a665c-9c89-4fe5-af55-3731bcd2456d" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-quobyte-4f5a665c-9c89-4fe5-af55-3731bcd2456d" released by "delete_volume" :: held 1.035s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Created reservations ['9faafed4-59d4-4fa4-a1e0-25febae1468e', 'a2cf4915-17ad-4cb6-8664-101931fe0198', 'aa55a436-1bef-4a6d-ae61-855044c9ee01', '64f32d46-bd04-4432-b339-5e217c67753a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:21 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:21 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:21 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Deleted volume successfully. Apr 15 10:16:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5f85d514-6606-4046-8ee9-216abea6d9d4 tempest-VolumesSnapshotTestJSON-163292371 None] Lock "cinder-4f5a665c-9c89-4fe5-af55-3731bcd2456d-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Uploaded volume to glance image-id: 3f0ac946-0e0c-4898-89cb-be0970c32ce5. {{(pid=82850) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.074s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1216201324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f157701-8780-4ff3-937d-3d0d5ca8a107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742d9262a4254a518aaa5b3b3f30bf34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:13Z,use_quota=True,user_id='e06b6527052a40619af155b02084bd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d088e0-53c8-4655-9c4e-0ab641536254),volume_type_id=28d088e0-53c8-4655-9c4e-0ab641536254)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Creating volume 8f157701-8780-4ff3-937d-3d0d5ca8a107 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:26 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-88264c08-a0f4-4a52-ab78-df3b5d1792d3 tempest-VolumesActionsTest-437002456 None] Copy volume to image completed successfully. Apr 15 10:16:26 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 1073741824 Apr 15 10:16:26 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (9eb8616a-4fe1-4ec9-897f-3435662e4444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:26 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2690b17d-9cd0-41f8-a001-7b40786ef1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2690b17d-9cd0-41f8-a001-7b40786ef1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695503555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c200abeb-942f-4ddd-af1a-0261bfa6dbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:27Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e246996-0798-4cb7-b8ad-f388e518b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e246996-0798-4cb7-b8ad-f388e518b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cc875f-8f51-40fc-b0c5-7064c866a203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cc875f-8f51-40fc-b0c5-7064c866a203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c200abeb-942f-4ddd-af1a-0261bfa6dbcc', 'volume_name': 'volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3db4ca-8058-4ba1-9b2f-6597435a032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3db4ca-8058-4ba1-9b2f-6597435a032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb270c1-cfd0-4510-8d65-1027629fe1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume c200abeb-942f-4ddd-af1a-0261bfa6dbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc', 'volume_size': 1} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 1073741824" returned: 0 in 0.675s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:27 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 Apr 15 10:16:27 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:27 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-695503555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c200abeb-942f-4ddd-af1a-0261bfa6dbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:27Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Creating volume c200abeb-942f-4ddd-af1a-0261bfa6dbcc {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:27 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4235713-d009-441a-a646-a3f28610c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f157701-8780-4ff3-937d-3d0d5ca8a107', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:27 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc 1073741824 Apr 15 10:16:27 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c68699-dc11-439c-bfee-127779988ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Volume volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 (8f157701-8780-4ff3-937d-3d0d5ca8a107): created successfully Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c68699-dc11-439c-bfee-127779988ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Flow 'volume_create_manager' (ad2565b2-04ed-4721-8b77-076670a82248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4af8c4e8-638a-41be-a59f-424f0f59fb60 tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Created volume successfully. Apr 15 10:16:28 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc 1073741824" returned: 0 in 0.530s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:28 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc Apr 15 10:16:28 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:28 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:28 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:28 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc" returned: 0 in 0.420s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.119s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb270c1-cfd0-4510-8d65-1027629fe1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661603af-4798-4cda-8849-3b1ce5e0cf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf78f4e7-2d3d-40f9-b6f3-0ac5fce9a161]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:28 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc (c200abeb-942f-4ddd-af1a-0261bfa6dbcc): created successfully Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661603af-4798-4cda-8849-3b1ce5e0cf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (9eb8616a-4fe1-4ec9-897f-3435662e4444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5cacc5a8-c72e-4c51-979d-db663b2e2e6a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created volume successfully. Apr 15 10:16:28 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:28 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:28 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.439s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:28 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0beca386-cd65-491d-90bb-fd483320224c tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Retype volume completed successfully. Apr 15 10:16:29 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.490s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a32673-98a9-411d-bcc0-ef9aff10f0e7]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:29 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:29 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (b083bb52-704a-4fad-b398-4dcc3ef45e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f9e646-a045-46d9-bda2-0518bf02c668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f9e646-a045-46d9-bda2-0518bf02c668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495604177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd56324-8334-48e6-a52d-1c6cd51188d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:29Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3263b953-c24d-414d-ac77-b3dd399980d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3263b953-c24d-414d-ac77-b3dd399980d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d684b75c-f613-4773-9d67-3af461fa4cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d684b75c-f613-4773-9d67-3af461fa4cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd56324-8334-48e6-a52d-1c6cd51188d2', 'volume_name': 'volume-fdd56324-8334-48e6-a52d-1c6cd51188d2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf82cbc-aeae-4bdf-b643-6c83d53360b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf82cbc-aeae-4bdf-b643-6c83d53360b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3d6a1a-ceca-4111-a5ce-3e5b2769f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume fdd56324-8334-48e6-a52d-1c6cd51188d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd56324-8334-48e6-a52d-1c6cd51188d2', 'volume_size': 1} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Acquiring lock "cinder-8f157701-8780-4ff3-937d-3d0d5ca8a107-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "cinder-8f157701-8780-4ff3-937d-3d0d5ca8a107-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Acquiring lock "cinder-quobyte-8f157701-8780-4ff3-937d-3d0d5ca8a107" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "cinder-quobyte-8f157701-8780-4ff3-937d-3d0d5ca8a107" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cce61c-2d05-4418-8364-e071f26509a5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:29 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.640s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:29 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img Apr 15 10:16:29 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:29 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 Apr 15 10:16:29 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (f0085f3a-8957-4f5d-a471-698a8dab0b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95a11d9-e564-42d4-bf40-f8d0509c3771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95a11d9-e564-42d4-bf40-f8d0509c3771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-70620990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b31a8f-ca67-4420-bcd6-e43fd272940d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:30Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9926cd3-d692-4fe4-a694-1f194bf0073e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9926cd3-d692-4fe4-a694-1f194bf0073e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bd0ff9-be35-460c-85ae-b697f23f4f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bd0ff9-be35-460c-85ae-b697f23f4f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b31a8f-ca67-4420-bcd6-e43fd272940d', 'volume_name': 'volume-52b31a8f-ca67-4420-bcd6-e43fd272940d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae35e125-0786-4be4-8f64-dc33dc46ad3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae35e125-0786-4be4-8f64-dc33dc46ad3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c00ce81-d8e9-4a76-9054-0475230134c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume 52b31a8f-ca67-4420-bcd6-e43fd272940d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b31a8f-ca67-4420-bcd6-e43fd272940d', 'volume_size': 1} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (17b7ce2e-fc12-4c3c-8bee-d53274e61128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b837c16-4962-4635-841d-d513de1c70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b837c16-4962-4635-841d-d513de1c70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-417012945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ed3a98-dc40-479b-8edc-2a04b9a9a35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:30Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d974475-a3b1-408b-a816-09c5de02a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d974475-a3b1-408b-a816-09c5de02a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d9d655-c099-4919-8f79-f81ad474c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d9d655-c099-4919-8f79-f81ad474c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ed3a98-dc40-479b-8edc-2a04b9a9a35e', 'volume_name': 'volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670a0cad-549b-483a-896a-5e50d2ff8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670a0cad-549b-483a-896a-5e50d2ff8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13de715a-45cf-4791-9167-0e01abcb45b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume 01ed3a98-dc40-479b-8edc-2a04b9a9a35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e', 'volume_size': 1} Apr 15 10:16:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (07afa9f7-6050-4a10-9971-945bde292c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42562ccf-88bd-4b09-a615-e8610b38ebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42562ccf-88bd-4b09-a615-e8610b38ebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597320081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5091b39-d7e9-4500-94cb-1221cac70361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:30Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6009f12-7163-44e6-9708-1b5812e95351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6009f12-7163-44e6-9708-1b5812e95351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e5eca-985d-4f2e-b53f-5ff931c5a502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e5eca-985d-4f2e-b53f-5ff931c5a502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5091b39-d7e9-4500-94cb-1221cac70361', 'volume_name': 'volume-c5091b39-d7e9-4500-94cb-1221cac70361', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ab1760-4fb1-49b7-b1b5-d88a94485cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ab1760-4fb1-49b7-b1b5-d88a94485cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d977d54a-ce5e-4c37-b2c5-4ba5e50a0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:30 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume c5091b39-d7e9-4500-94cb-1221cac70361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5091b39-d7e9-4500-94cb-1221cac70361', 'volume_size': 1} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:30 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107" returned: 0 in 0.785s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:30 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107 Apr 15 10:16:30 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (25665b5a-c494-49d7-9ca6-ac6618bf0f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8e4ab3-7f47-4b9e-8547-16e491851bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8e4ab3-7f47-4b9e-8547-16e491851bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642237359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c100adf-9609-4bcd-b480-1760d11b9a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:31Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a055404-884e-480c-bdbe-85425940545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a055404-884e-480c-bdbe-85425940545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bac7cc-12d5-4633-9162-135d04c2bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bac7cc-12d5-4633-9162-135d04c2bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c100adf-9609-4bcd-b480-1760d11b9a4a', 'volume_name': 'volume-6c100adf-9609-4bcd-b480-1760d11b9a4a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c202c9-2c2a-4a83-8e7a-f2ffec69803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c202c9-2c2a-4a83-8e7a-f2ffec69803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b330d3-97de-441c-b646-e244b98e1dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:31 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume 6c100adf-9609-4bcd-b480-1760d11b9a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c100adf-9609-4bcd-b480-1760d11b9a4a', 'volume_size': 1} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:31 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8f157701-8780-4ff3-937d-3d0d5ca8a107" returned: 0 in 1.443s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "cinder-quobyte-8f157701-8780-4ff3-937d-3d0d5ca8a107" released by "delete_volume" :: held 2.268s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:31 devstack cinder-volume[82850]: WARNING cinder.quota [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:16:31 devstack cinder-volume[82850]: WARNING cinder.quota [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Created reservations ['5ae7fa8d-8bc1-4288-ad20-cdb0fce1e65a', 'd43b4851-e66b-4c2d-b403-a5f3d1a963cb', '4a269977-c348-4ce1-9fa2-ad6e8c61d920', '1b3b8f76-9b53-40a4-bb02-629bc94725c7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:32 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:32 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:32 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img" returned: 0 in 2.466s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[10088589-e581-451c-b30b-1e62669b4265]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:32 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:32 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:32 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.397s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:32 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Deleted volume successfully. Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c94bf86e-a139-47b4-9e19-7af68fa4943e tempest-VolumeRetypeWithoutMigrationTest-741407186 None] Lock "cinder-8f157701-8780-4ff3-937d-3d0d5ca8a107-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:32 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.614s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:32 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Converted 1024.00 MB image at 414.98 MB/s Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] a9f1eeb7-7b79-465c-8a8f-73d07175af34 was raw, converting to qcow2 {{(pid=82850) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b0c9d-c787-4947-9aa2-7aa2b0da2a80]: (4, 'raw') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:32 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img Apr 15 10:16:32 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:33 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img" returned: 0 in 0.530s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:33 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:33 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:33 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img Apr 15 10:16:33 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:33 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:33 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img" returned: 1 in 0.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img' failed. Not Retrying. {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:16:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img /opt/stack/data/cinder/conversion/vol_upload_jnb4qpw2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:33 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img /opt/stack/data/cinder/conversion/vol_upload_jnb4qpw2 Apr 15 10:16:33 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:34 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img /opt/stack/data/cinder/conversion/vol_upload_jnb4qpw2" returned: 0 in 0.556s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:34 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Image conversion details: src /opt/stack/data/cinder/conversion/d1a7693d-8305-4c03-9c11-15a23a63455c.temp_image.a9f1eeb7-7b79-465c-8a8f-73d07175af34aqwkdf6k.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jnb4qpw2 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:34 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 10:16:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf0777-4f02-4ca4-bffb-d1d79a1ac261]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jnb4qpw2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:34 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jnb4qpw2 Apr 15 10:16:34 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:34 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jnb4qpw2" returned: 0 in 0.537s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.350s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Uploaded volume to glance image-id: a9f1eeb7-7b79-465c-8a8f-73d07175af34. {{(pid=82850) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.356s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495604177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd56324-8334-48e6-a52d-1c6cd51188d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:29Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Creating volume fdd56324-8334-48e6-a52d-1c6cd51188d2 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:35 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:35 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 1073741824 Apr 15 10:16:35 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-38831a61-f605-436e-838f-b57fca865485 tempest-VolumesActionsTest-437002456 None] Copy volume to image completed successfully. Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Flow 'volume_create_manager' (363b6160-44ed-4303-84fc-b57eba1fbd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4a4b65-ed1b-4044-aefd-c14cd63bc634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4a4b65-ed1b-4044-aefd-c14cd63bc634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1830610219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32a9f21-8f41-42c4-89b8-1a9f1536ee46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435a140f614ae78114d90076870cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:36Z,use_quota=True,user_id='193844d3db6d433288d74b794fb118f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0b408b-9122-4bfb-b3bc-33351a3a098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0b408b-9122-4bfb-b3bc-33351a3a098c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223d33db-b7cf-408c-8c85-4f103b74a218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223d33db-b7cf-408c-8c85-4f103b74a218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32a9f21-8f41-42c4-89b8-1a9f1536ee46', 'volume_name': 'volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf07610-03e1-4673-a4ae-02ae3a66b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf07610-03e1-4673-a4ae-02ae3a66b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b124cb77-5a50-41c0-bf65-e6c3eae358da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:36 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Volume d32a9f21-8f41-42c4-89b8-1a9f1536ee46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46', 'volume_size': 1} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:36 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 1073741824" returned: 0 in 0.604s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:36 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 Apr 15 10:16:36 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:36 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.161s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-70620990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b31a8f-ca67-4420-bcd6-e43fd272940d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:30Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Creating volume 52b31a8f-ca67-4420-bcd6-e43fd272940d {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:36 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3d6a1a-ceca-4111-a5ce-3e5b2769f705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd56324-8334-48e6-a52d-1c6cd51188d2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4e2499-3f30-4d6f-ab7f-34357b62f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:37 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d 1073741824 Apr 15 10:16:37 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:37 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 (fdd56324-8334-48e6-a52d-1c6cd51188d2): created successfully Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4e2499-3f30-4d6f-ab7f-34357b62f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (b083bb52-704a-4fad-b398-4dcc3ef45e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7c1e5fba-62e0-4238-9676-536265326d54 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created volume successfully. Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Acquiring lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Acquiring lock "cinder-quobyte-d1a7693d-8305-4c03-9c11-15a23a63455c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Lock "cinder-quobyte-d1a7693d-8305-4c03-9c11-15a23a63455c" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f8f93-bd42-4157-93b6-30d1d120ce32]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:37 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:37 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:37 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d 1073741824" returned: 0 in 0.548s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:37 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d Apr 15 10:16:37 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:37 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.558s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:37 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c Apr 15 10:16:37 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:37 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d" returned: 0 in 0.426s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-417012945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ed3a98-dc40-479b-8edc-2a04b9a9a35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:30Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Creating volume 01ed3a98-dc40-479b-8edc-2a04b9a9a35e {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:37 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c00ce81-d8e9-4a76-9054-0475230134c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b31a8f-ca67-4420-bcd6-e43fd272940d', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:38 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e 1073741824 Apr 15 10:16:38 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354ebc16-35b3-4b9c-a3c3-906fcfb8dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume volume-52b31a8f-ca67-4420-bcd6-e43fd272940d (52b31a8f-ca67-4420-bcd6-e43fd272940d): created successfully Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354ebc16-35b3-4b9c-a3c3-906fcfb8dce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (f0085f3a-8957-4f5d-a471-698a8dab0b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e2ecf4f0-61c2-49ce-b181-8c88dc5007a6 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created volume successfully. Apr 15 10:16:38 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d1a7693d-8305-4c03-9c11-15a23a63455c" returned: 0 in 0.443s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Lock "cinder-quobyte-d1a7693d-8305-4c03-9c11-15a23a63455c" released by "delete_volume" :: held 1.025s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Created reservations ['13a28fef-f2d9-4aef-bfe2-5e95658f44d2', '161aa118-ba6d-40ca-9b14-e21cfe24ec24', '6a469c9c-7cc2-404d-8420-851c4dd201f9', '38ce680b-f934-49d7-af90-c9a6fdea98e8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:38 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:38 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:38 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e 1073741824" returned: 0 in 0.575s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:38 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e Apr 15 10:16:38 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:38 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.488s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Deleted volume successfully. Apr 15 10:16:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-32c438e9-087d-465d-b99c-4006ec77547d tempest-VolumesActionsTest-437002456 None] Lock "cinder-d1a7693d-8305-4c03-9c11-15a23a63455c-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:38 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e" returned: 0 in 0.424s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.741s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597320081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5091b39-d7e9-4500-94cb-1221cac70361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:30Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Creating volume c5091b39-d7e9-4500-94cb-1221cac70361 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:39 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13de715a-45cf-4791-9167-0e01abcb45b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:39 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 1073741824 Apr 15 10:16:39 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9efc19-3b9c-4043-a633-03eec6efcd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:39 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e (01ed3a98-dc40-479b-8edc-2a04b9a9a35e): created successfully Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9efc19-3b9c-4043-a633-03eec6efcd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (17b7ce2e-fc12-4c3c-8bee-d53274e61128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c4971618-0b96-4b55-b9b8-d6b13dcf8195 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created volume successfully. Apr 15 10:16:39 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 1073741824" returned: 0 in 0.563s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:39 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 Apr 15 10:16:39 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:40 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.395s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642237359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c100adf-9609-4bcd-b480-1760d11b9a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3d9a9bcf804d1aa1f7da14dc5df274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:31Z,use_quota=True,user_id='ca80819e95e54c759bf78091ac8b9d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Creating volume 6c100adf-9609-4bcd-b480-1760d11b9a4a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:40 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d977d54a-ce5e-4c37-b2c5-4ba5e50a0854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5091b39-d7e9-4500-94cb-1221cac70361', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:40 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a 1073741824 Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d93cd19-6828-4f30-aa1d-4dc4919a12f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:40 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume volume-c5091b39-d7e9-4500-94cb-1221cac70361 (c5091b39-d7e9-4500-94cb-1221cac70361): created successfully Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d93cd19-6828-4f30-aa1d-4dc4919a12f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (07afa9f7-6050-4a10-9971-945bde292c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0b9358b3-3971-4698-b6e9-da48efd8c6c9 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created volume successfully. Apr 15 10:16:40 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a 1073741824" returned: 0 in 0.611s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:40 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a Apr 15 10:16:40 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:41 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.773s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1830610219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32a9f21-8f41-42c4-89b8-1a9f1536ee46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435a140f614ae78114d90076870cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:36Z,use_quota=True,user_id='193844d3db6d433288d74b794fb118f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Creating volume d32a9f21-8f41-42c4-89b8-1a9f1536ee46 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:41 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b330d3-97de-441c-b646-e244b98e1dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c100adf-9609-4bcd-b480-1760d11b9a4a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e02757-2c99-4e5b-ae2e-f77166e419c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:41 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 1073741824 Apr 15 10:16:41 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:41 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Volume volume-6c100adf-9609-4bcd-b480-1760d11b9a4a (6c100adf-9609-4bcd-b480-1760d11b9a4a): created successfully Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e02757-2c99-4e5b-ae2e-f77166e419c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Flow 'volume_create_manager' (25665b5a-c494-49d7-9ca6-ac6618bf0f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:41 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-002bb881-3cc8-44be-8325-5cbdfca1a7ba tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created volume successfully. Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-6c100adf-9609-4bcd-b480-1760d11b9a4a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:41 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 1073741824" returned: 0 in 0.627s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-6c100adf-9609-4bcd-b480-1760d11b9a4a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-quobyte-6c100adf-9609-4bcd-b480-1760d11b9a4a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:41 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 Apr 15 10:16:41 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-6c100adf-9609-4bcd-b480-1760d11b9a4a" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d121ecf-e372-4f31-a97d-927c1b2b4136]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:42 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a Apr 15 10:16:42 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:42 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46" returned: 0 in 0.524s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b124cb77-5a50-41c0-bf65-e6c3eae358da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d33c6fb-3cc9-4931-aaf9-5a581b6d2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:42 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Volume volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 (d32a9f21-8f41-42c4-89b8-1a9f1536ee46): created successfully Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d33c6fb-3cc9-4931-aaf9-5a581b6d2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Flow 'volume_create_manager' (363b6160-44ed-4303-84fc-b57eba1fbd53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fc16ca64-e916-40fb-a117-283fde632cd3 tempest-VolumesServicesTestJSON-1554958133 None] Created volume successfully. Apr 15 10:16:42 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a" returned: 0 in 0.632s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:42 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a Apr 15 10:16:42 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Acquiring lock "cinder-d32a9f21-8f41-42c4-89b8-1a9f1536ee46-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Lock "cinder-d32a9f21-8f41-42c4-89b8-1a9f1536ee46-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Acquiring lock "cinder-quobyte-d32a9f21-8f41-42c4-89b8-1a9f1536ee46" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Lock "cinder-quobyte-d32a9f21-8f41-42c4-89b8-1a9f1536ee46" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c3b8fe-ec4f-4d9f-91a5-9f0be878ebfc]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:42 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 Apr 15 10:16:42 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:43 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6c100adf-9609-4bcd-b480-1760d11b9a4a" returned: 0 in 0.518s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-6c100adf-9609-4bcd-b480-1760d11b9a4a" released by "delete_volume" :: held 1.177s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created reservations ['061ab6f2-69ef-4b72-ab0c-d23346211326', '190bea0d-57ec-42ae-badf-87afc62bca28', 'fd218eb8-6287-489e-88e6-696f7254ed3e', '83e0598f-708f-4100-8cba-aebcfda7f1cd'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:43 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:43 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:43 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46" returned: 0 in 0.583s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:43 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46 Apr 15 10:16:43 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:43 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.473s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:43 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Deleted volume successfully. Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0f079c5f-f858-4f76-a9a9-921fa95c3158 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-6c100adf-9609-4bcd-b480-1760d11b9a4a-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Flow 'volume_create_manager' (864edb63-a565-4c7f-a85c-75b86be45561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed88b1a-2c26-4325-b571-e6064208b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:43 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed88b1a-2c26-4325-b571-e6064208b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1340976976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8a984-6c11-49cf-9a98-66903dbc7b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233d7cab137a4e1eaafc83dcacfa5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:44Z,use_quota=True,user_id='004ae541d53e46a4a1126c52606356de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212d7304-d52b-4b40-afbd-7849a36f3f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212d7304-d52b-4b40-afbd-7849a36f3f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2b50ef-6102-4a8e-9f9a-ecda4ccd9050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2b50ef-6102-4a8e-9f9a-ecda4ccd9050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e8a984-6c11-49cf-9a98-66903dbc7b9b', 'volume_name': 'volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb00b3e-304e-4e63-94d7-8f7e5851f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb00b3e-304e-4e63-94d7-8f7e5851f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e28bd0-c301-4f17-a382-60f98e28d778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Volume 10e8a984-6c11-49cf-9a98-66903dbc7b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b', 'volume_size': 1} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1340976976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e8a984-6c11-49cf-9a98-66903dbc7b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233d7cab137a4e1eaafc83dcacfa5755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:44Z,use_quota=True,user_id='004ae541d53e46a4a1126c52606356de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Creating volume 10e8a984-6c11-49cf-9a98-66903dbc7b9b {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:43 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d32a9f21-8f41-42c4-89b8-1a9f1536ee46" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:44 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b 1073741824 Apr 15 10:16:44 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Lock "cinder-quobyte-d32a9f21-8f41-42c4-89b8-1a9f1536ee46" released by "delete_volume" :: held 1.135s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-c5091b39-d7e9-4500-94cb-1221cac70361-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-c5091b39-d7e9-4500-94cb-1221cac70361-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-quobyte-c5091b39-d7e9-4500-94cb-1221cac70361" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Created reservations ['383347bd-4d3b-48c4-9ab4-beed49e78827', '08c9067c-820b-4805-b2cd-029ef35067d7', '3ab93c03-58af-46ed-88ad-87eddc625c70', 'bdb720f6-bd91-41b7-8e84-1718d10ebbc6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-c5091b39-d7e9-4500-94cb-1221cac70361" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f97f275-9fcf-4cc1-8be5-66030eb1fbbb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:44 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 Apr 15 10:16:44 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:44 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:44 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:44 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b 1073741824" returned: 0 in 0.520s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:44 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b Apr 15 10:16:44 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:44 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.433s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Deleted volume successfully. Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-84d76074-32b6-4322-9e90-7f5d16644afa tempest-VolumesServicesTestJSON-1554958133 None] Lock "cinder-d32a9f21-8f41-42c4-89b8-1a9f1536ee46-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:44 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:44 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361 Apr 15 10:16:44 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:45 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e28bd0-c301-4f17-a382-60f98e28d778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36add3b-b0f3-40d1-b50f-efda5098573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:45 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c5091b39-d7e9-4500-94cb-1221cac70361" returned: 0 in 0.409s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Volume volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b (10e8a984-6c11-49cf-9a98-66903dbc7b9b): created successfully Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36add3b-b0f3-40d1-b50f-efda5098573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Flow 'volume_create_manager' (864edb63-a565-4c7f-a85c-75b86be45561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-c5091b39-d7e9-4500-94cb-1221cac70361" released by "delete_volume" :: held 0.975s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-edc498ef-bd68-48c5-b10f-1e5f23e0cd79 tempest-VolumesNegativeTest-1696671856 None] Created volume successfully. Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created reservations ['b92d084e-14fe-4b4e-b114-00de33793717', '3063a8fa-78d6-4025-84f1-c7b8b107ca6b', '0c7827d5-9ea9-442e-9056-3d3f07ac7839', '4590c49d-80f5-4151-90d5-0e9f8c60583a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:45 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:45 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:45 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.462s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:45 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Deleted volume successfully. Apr 15 10:16:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-37845d0b-0c83-4f27-9481-eba88534a2b1 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-c5091b39-d7e9-4500-94cb-1221cac70361-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-01ed3a98-dc40-479b-8edc-2a04b9a9a35e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-01ed3a98-dc40-479b-8edc-2a04b9a9a35e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-quobyte-01ed3a98-dc40-479b-8edc-2a04b9a9a35e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:46 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-01ed3a98-dc40-479b-8edc-2a04b9a9a35e" acquired by "delete_volume" :: waited 0.034s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:46 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4db79e-672f-4f89-9af4-27dcb9e3b0fd]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:46 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e Apr 15 10:16:46 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:46 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e" returned: 0 in 0.650s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:47 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e Apr 15 10:16:47 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:47 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-01ed3a98-dc40-479b-8edc-2a04b9a9a35e" returned: 0 in 0.504s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-01ed3a98-dc40-479b-8edc-2a04b9a9a35e" released by "delete_volume" :: held 1.204s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created reservations ['530911d9-62fb-452a-bd75-4f8c1a9216d2', '41c98158-07a1-4ea4-ab35-2fc619b58b54', '67c45e76-408a-422d-add9-3215e3abd9a2', '318efa21-11f9-488a-917c-69e735fb7f20'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:47 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:47 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:48 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Deleted volume successfully. Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-74146e88-89e0-45bb-88f5-0cf1ae988c8a tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-01ed3a98-dc40-479b-8edc-2a04b9a9a35e-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-52b31a8f-ca67-4420-bcd6-e43fd272940d-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-52b31a8f-ca67-4420-bcd6-e43fd272940d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-quobyte-52b31a8f-ca67-4420-bcd6-e43fd272940d" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-52b31a8f-ca67-4420-bcd6-e43fd272940d" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5a01e9-8126-46b1-b16f-5735a4cd7f64]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:48 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d Apr 15 10:16:48 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:49 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d" returned: 0 in 0.553s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:49 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d Apr 15 10:16:49 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:49 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-52b31a8f-ca67-4420-bcd6-e43fd272940d" returned: 0 in 0.541s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-52b31a8f-ca67-4420-bcd6-e43fd272940d" released by "delete_volume" :: held 1.119s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created reservations ['3c1a4068-452a-4b5a-b87c-20e03c43eb62', '97149944-620b-4b64-b83c-11a77298d8a6', '5d419d33-8dea-474b-90c1-7ab3e5520683', 'ca74b931-1199-4ac8-9497-a627c9aae75e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:49 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:49 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:50 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.522s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Deleted volume successfully. Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e4335d8d-0699-4e17-b131-bf4a5769b9aa tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-52b31a8f-ca67-4420-bcd6-e43fd272940d-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-fdd56324-8334-48e6-a52d-1c6cd51188d2-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-fdd56324-8334-48e6-a52d-1c6cd51188d2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-quobyte-fdd56324-8334-48e6-a52d-1c6cd51188d2" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-fdd56324-8334-48e6-a52d-1c6cd51188d2" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f7a76d-5e11-45a8-806b-42798504cd17]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:50 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 Apr 15 10:16:50 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:51 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2" returned: 0 in 0.646s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:51 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2 Apr 15 10:16:51 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Flow 'volume_create_manager' (a44185a8-a065-40e3-bdb3-f36cd9b425fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6ab64d-ff92-43fd-960b-c6b590c43e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6ab64d-ff92-43fd-960b-c6b590c43e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-626016791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ee0a4d-3791-41a1-9382-81b09e744856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e652ed785c480c9045ae7f8c584ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:52Z,use_quota=True,user_id='c9bfe41947784be49dcea0faf6d82b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19f7283-49f5-41f9-85e6-cb55e07be1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19f7283-49f5-41f9-85e6-cb55e07be1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3a8858-10d5-4ed1-adeb-5995daaea8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3a8858-10d5-4ed1-adeb-5995daaea8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ee0a4d-3791-41a1-9382-81b09e744856', 'volume_name': 'volume-c7ee0a4d-3791-41a1-9382-81b09e744856', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2120a58b-4d98-466e-b2b1-244179dc9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2120a58b-4d98-466e-b2b1-244179dc9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91da6af2-393e-4de8-81c5-bd26360cef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Volume c7ee0a4d-3791-41a1-9382-81b09e744856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ee0a4d-3791-41a1-9382-81b09e744856', 'volume_size': 1} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-626016791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ee0a4d-3791-41a1-9382-81b09e744856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69e652ed785c480c9045ae7f8c584ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:52Z,use_quota=True,user_id='c9bfe41947784be49dcea0faf6d82b6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Creating volume c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:51 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 1073741824 Apr 15 10:16:51 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:51 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-fdd56324-8334-48e6-a52d-1c6cd51188d2" returned: 0 in 0.527s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-fdd56324-8334-48e6-a52d-1c6cd51188d2" released by "delete_volume" :: held 1.208s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created reservations ['4cff6a57-b1a2-4057-8411-f2ec2a202c17', '6866fb16-b529-42d0-afb1-904cd1ef222a', '2c4afc65-9d1c-490d-baac-5a76be544844', '73905bf7-22ec-47e6-9bbf-bc2b9adf6f16'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:52 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:52 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:52 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 1073741824" returned: 0 in 0.613s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:52 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 Apr 15 10:16:52 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:52 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.589s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Deleted volume successfully. Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-472ca617-1af2-43bd-8e41-808d526d6ee3 tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-fdd56324-8334-48e6-a52d-1c6cd51188d2-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-c200abeb-942f-4ddd-af1a-0261bfa6dbcc-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-c200abeb-942f-4ddd-af1a-0261bfa6dbcc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "cinder-quobyte-c200abeb-942f-4ddd-af1a-0261bfa6dbcc" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-c200abeb-942f-4ddd-af1a-0261bfa6dbcc" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[334e9d86-3772-4e95-969e-5162f1e885a6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:52 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856" returned: 0 in 0.539s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91da6af2-393e-4de8-81c5-bd26360cef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ee0a4d-3791-41a1-9382-81b09e744856', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0258ce3-11c9-4835-a552-714fa434f5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Volume volume-c7ee0a4d-3791-41a1-9382-81b09e744856 (c7ee0a4d-3791-41a1-9382-81b09e744856): created successfully Apr 15 10:16:52 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc Apr 15 10:16:52 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0258ce3-11c9-4835-a552-714fa434f5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Flow 'volume_create_manager' (a44185a8-a065-40e3-bdb3-f36cd9b425fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-14f348fb-8c0c-49e4-badc-1f6c2b8c543b tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Created volume successfully. Apr 15 10:16:53 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc" returned: 0 in 0.519s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:53 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc Apr 15 10:16:53 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:53 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c200abeb-942f-4ddd-af1a-0261bfa6dbcc" returned: 0 in 0.490s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-quobyte-c200abeb-942f-4ddd-af1a-0261bfa6dbcc" released by "delete_volume" :: held 1.032s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Creating offline snapshot 91fa416e-2623-43ba-89b9-1bcf513c5605 of volume c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[28689350-dd13-4e40-8cf3-5b9bbd5d89e7]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:53 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Created reservations ['e27ad588-b048-42e3-8265-689fd2f69b00', '04c3e5b8-5570-4d28-b05c-0ce8302e66d5', '0c0ebc64-5ef0-424d-a62d-0c592d8499ce', 'ad38dfd2-fc00-47bd-b00a-32896b3aa060'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:54 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 Apr 15 10:16:54 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:54 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:16:54 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:54 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856" returned: 0 in 0.483s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:54 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 1G Apr 15 10:16:54 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:54 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.452s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Deleted volume successfully. Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-61a30029-ac22-4c37-aed8-3308585d41bd tempest-CreateVolumesFromSourceVolumeTest-1059345876 None] Lock "cinder-c200abeb-942f-4ddd-af1a-0261bfa6dbcc-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:54 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 1G" returned: 0 in 0.570s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ee0a4d-3791-41a1-9382-81b09e744856 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:55 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ee0a4d-3791-41a1-9382-81b09e744856 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 Apr 15 10:16:55 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:55 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ee0a4d-3791-41a1-9382-81b09e744856 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605" returned: 0 in 0.560s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:55 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 is being set with open permissions: ugo+rw Apr 15 10:16:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:55 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 Apr 15 10:16:55 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:56 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=175,cinder:SELECT=145,cinder:INSERT=42,cinder:DELETE=17 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=141,cinder:INSERT=39,cinder:UPDATE=182,cinder:DELETE=10 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:56 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.info Apr 15 10:16:56 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:56 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.info" returned: 0 in 0.452s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:56 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.info is being set with open permissions: ugo+rw Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:56 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.info Apr 15 10:16:56 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:56 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.info" returned: 0 in 0.433s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.061s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:57 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-056424c7-1e77-41b8-bba5-3e1892a7373c tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Create snapshot completed successfully Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "cinder-91fa416e-2623-43ba-89b9-1bcf513c5605-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-91fa416e-2623-43ba-89b9-1bcf513c5605-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "cinder-quobyte-c7ee0a4d-3791-41a1-9382-81b09e744856" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-quobyte-c7ee0a4d-3791-41a1-9382-81b09e744856" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "cinder-quobyte-91fa416e-2623-43ba-89b9-1bcf513c5605" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-quobyte-91fa416e-2623-43ba-89b9-1bcf513c5605" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Deleting offline snapshot 91fa416e-2623-43ba-89b9-1bcf513c5605 of volume c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] snapshot_file for this snap is: volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5fecc-0619-4749-a8a0-4d1a488f216b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:58 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 Apr 15 10:16:58 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:59 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605" returned: 0 in 0.514s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ee0a4d-3791-41a1-9382-81b09e744856(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2434a48-ce06-402e-baaa-26111937b6b4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:59 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 Apr 15 10:16:59 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:59 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856" returned: 0 in 0.615s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:59 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 Apr 15 10:16:59 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:00 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605" returned: 0 in 0.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:00 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605 Apr 15 10:17:00 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:00 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856.91fa416e-2623-43ba-89b9-1bcf513c5605" returned: 0 in 0.430s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-quobyte-91fa416e-2623-43ba-89b9-1bcf513c5605" released by "_delete_snapshot" :: held 2.159s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-quobyte-c7ee0a4d-3791-41a1-9382-81b09e744856" released by "delete_snapshot" :: held 2.175s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Created reservations ['c38dca1f-dbd1-4906-b197-c33ab31e039e', '7c0413f7-1281-4d57-92d1-27417408078f', '1c4d733b-20c7-4358-a481-631690813631', '1caa047a-b324-4dc7-b5d9-1163b2c1b4dd'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Delete snapshot completed successfully. Apr 15 10:17:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-51f190f7-fe73-407b-bb29-d0117ea0fac8 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-91fa416e-2623-43ba-89b9-1bcf513c5605-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "cinder-c7ee0a4d-3791-41a1-9382-81b09e744856-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-c7ee0a4d-3791-41a1-9382-81b09e744856-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "cinder-quobyte-c7ee0a4d-3791-41a1-9382-81b09e744856" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-quobyte-c7ee0a4d-3791-41a1-9382-81b09e744856" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5a9d6e-4289-4ec8-913f-1652b8d2be47]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:01 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 Apr 15 10:17:01 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:02 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856" returned: 0 in 0.582s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:02 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856 Apr 15 10:17:02 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:02 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-c7ee0a4d-3791-41a1-9382-81b09e744856" returned: 0 in 0.467s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-quobyte-c7ee0a4d-3791-41a1-9382-81b09e744856" released by "delete_volume" :: held 1.093s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Created reservations ['af694fde-b2a5-4a07-9283-3933e0052281', '2f8174c7-ab5c-4a77-9d8d-311dfb96433f', '23429735-a44e-45f8-bef1-8bd88cc00e11', '51d25ac9-9000-4228-aa68-f4597ef42e5e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:02 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:02 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:03 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.417s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:03 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Deleted volume successfully. Apr 15 10:17:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3b715950-f6f5-4baa-a657-5f9c6c6a0065 tempest-VolumeSnapshotQuotasNegativeTestJSON-482636412 None] Lock "cinder-c7ee0a4d-3791-41a1-9382-81b09e744856-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Flow 'volume_create_manager' (3387d1a2-13bf-4750-8ced-021ed0d99a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9479f113-2974-4625-af70-825a032810bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9479f113-2974-4625-af70-825a032810bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-944220596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590d8ce8-bac1-49b2-8538-852f78cad60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8c070d658b42e58fb84a3ffdc6ba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:10Z,use_quota=True,user_id='a5155857e52b419abfdb05aaaafc4ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f286e34d-fb13-4805-b580-6e9327cdfed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f286e34d-fb13-4805-b580-6e9327cdfed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631e7dad-b625-4ab9-9d16-2b5c98291df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631e7dad-b625-4ab9-9d16-2b5c98291df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590d8ce8-bac1-49b2-8538-852f78cad60b', 'volume_name': 'volume-590d8ce8-bac1-49b2-8538-852f78cad60b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae8da20-47dc-4379-a74e-10a74f4028b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae8da20-47dc-4379-a74e-10a74f4028b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ca7c0-e45c-49b3-8171-67446124db6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Volume 590d8ce8-bac1-49b2-8538-852f78cad60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590d8ce8-bac1-49b2-8538-852f78cad60b', 'volume_size': 1} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-944220596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590d8ce8-bac1-49b2-8538-852f78cad60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8c070d658b42e58fb84a3ffdc6ba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:10Z,use_quota=True,user_id='a5155857e52b419abfdb05aaaafc4ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Creating volume 590d8ce8-bac1-49b2-8538-852f78cad60b {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:10 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:10 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b 1073741824 Apr 15 10:17:10 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:10 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b 1073741824" returned: 0 in 0.567s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:10 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b Apr 15 10:17:10 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Acquiring lock "cinder-10e8a984-6c11-49cf-9a98-66903dbc7b9b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Lock "cinder-10e8a984-6c11-49cf-9a98-66903dbc7b9b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Acquiring lock "cinder-quobyte-10e8a984-6c11-49cf-9a98-66903dbc7b9b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Lock "cinder-quobyte-10e8a984-6c11-49cf-9a98-66903dbc7b9b" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd47d8ef-0f7d-4b25-8e57-2197fcd8e26b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:11 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ca7c0-e45c-49b3-8171-67446124db6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590d8ce8-bac1-49b2-8538-852f78cad60b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d163d635-67b9-4c74-a164-4d7c870a44db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:11 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Volume volume-590d8ce8-bac1-49b2-8538-852f78cad60b (590d8ce8-bac1-49b2-8538-852f78cad60b): created successfully Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d163d635-67b9-4c74-a164-4d7c870a44db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Flow 'volume_create_manager' (3387d1a2-13bf-4750-8ced-021ed0d99a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ea201c82-de0c-4aad-ae14-7a1dc4cd0d24 tempest-VolumesListAdminTestJSON-939129125 None] Created volume successfully. Apr 15 10:17:11 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b Apr 15 10:17:11 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:11 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b" returned: 0 in 0.516s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:11 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b Apr 15 10:17:11 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:12 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-10e8a984-6c11-49cf-9a98-66903dbc7b9b" returned: 0 in 0.435s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Lock "cinder-quobyte-10e8a984-6c11-49cf-9a98-66903dbc7b9b" released by "delete_volume" :: held 0.985s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Created reservations ['c14aa4b6-1c8e-4015-ac5e-63100c5fa465', '63c9e196-74c3-4c7b-85e1-506f43db08df', '65b7122e-356a-462a-b04f-88126425cd80', 'bb59cf87-d18a-48d4-bacb-ae5fa77da0f6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:12 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:12 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Flow 'volume_create_manager' (fb0e8055-6a58-4ee3-b3bf-6cf9453dad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bafcc2-712d-4038-a9cb-13e9628c996b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bafcc2-712d-4038-a9cb-13e9628c996b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1572919830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af3e1db-d4e9-4e55-af25-7199d4ee66ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8c070d658b42e58fb84a3ffdc6ba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:13Z,use_quota=True,user_id='a5155857e52b419abfdb05aaaafc4ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcff4adc-c07a-4253-82f2-0600b29e2745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcff4adc-c07a-4253-82f2-0600b29e2745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5100a13-f243-4d19-a85c-ca8b5fbc3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5100a13-f243-4d19-a85c-ca8b5fbc3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5af3e1db-d4e9-4e55-af25-7199d4ee66ad', 'volume_name': 'volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e48733a-14aa-4cb7-a87a-92dc48d1d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e48733a-14aa-4cb7-a87a-92dc48d1d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfad0872-2f5f-4fd6-a8b9-0b3d6ce3b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:12 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Volume 5af3e1db-d4e9-4e55-af25-7199d4ee66ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad', 'volume_size': 1} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1572919830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af3e1db-d4e9-4e55-af25-7199d4ee66ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8c070d658b42e58fb84a3ffdc6ba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:13Z,use_quota=True,user_id='a5155857e52b419abfdb05aaaafc4ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Creating volume 5af3e1db-d4e9-4e55-af25-7199d4ee66ad {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:12 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:12 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad 1073741824 Apr 15 10:17:12 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:12 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.555s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:12 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Deleted volume successfully. Apr 15 10:17:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-89c92f8d-5cc6-4db1-bf69-12f1fe63497a tempest-VolumesNegativeTest-1696671856 None] Lock "cinder-10e8a984-6c11-49cf-9a98-66903dbc7b9b-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:13 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad 1073741824" returned: 0 in 0.559s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:13 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad Apr 15 10:17:13 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:13 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfad0872-2f5f-4fd6-a8b9-0b3d6ce3b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a64a1-609b-42a1-8ad1-e1e8db7fad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:13 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Volume volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad (5af3e1db-d4e9-4e55-af25-7199d4ee66ad): created successfully Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56a64a1-609b-42a1-8ad1-e1e8db7fad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:13 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Flow 'volume_create_manager' (fb0e8055-6a58-4ee3-b3bf-6cf9453dad73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1034b38c-e73c-4aab-8f97-b0ae5e563053 tempest-VolumesListAdminTestJSON-939129125 None] Created volume successfully. Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (6c166926-33d0-493e-8c3f-1d30481d778e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe0369c-2c07-4310-b1b6-b7ead7d595a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe0369c-2c07-4310-b1b6-b7ead7d595a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427799732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78605737-8a3b-4174-8821-6d3c0e71f11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:14Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b205a7a-c8ec-4254-abfc-bdb0841a4ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b205a7a-c8ec-4254-abfc-bdb0841a4ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1173345-8fb3-45d4-9d3a-1dec76475819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1173345-8fb3-45d4-9d3a-1dec76475819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78605737-8a3b-4174-8821-6d3c0e71f11f', 'volume_name': 'volume-78605737-8a3b-4174-8821-6d3c0e71f11f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8758c477-d9a2-4633-9f58-9751010a298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8758c477-d9a2-4633-9f58-9751010a298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ac2cb3-7b48-40c2-8cd3-81ef564559d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume 78605737-8a3b-4174-8821-6d3c0e71f11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78605737-8a3b-4174-8821-6d3c0e71f11f', 'volume_size': 1} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427799732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78605737-8a3b-4174-8821-6d3c0e71f11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:14Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Creating volume 78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:14 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f 1073741824 Apr 15 10:17:14 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:14 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f 1073741824" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:14 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f Apr 15 10:17:14 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Flow 'volume_create_manager' (9848f439-6272-4455-81f4-300c8e830c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4ebb1f-f82f-4a70-bc0b-c61396267291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:15 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4ebb1f-f82f-4a70-bc0b-c61396267291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-438351475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175c009c-5c45-4825-82b8-0a67bf344e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8c070d658b42e58fb84a3ffdc6ba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:15Z,use_quota=True,user_id='a5155857e52b419abfdb05aaaafc4ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a989e3-cf71-4af7-8c07-be798767f8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a989e3-cf71-4af7-8c07-be798767f8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbbfc6b-a706-43bd-b9bf-1257d6fc032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbbfc6b-a706-43bd-b9bf-1257d6fc032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175c009c-5c45-4825-82b8-0a67bf344e47', 'volume_name': 'volume-175c009c-5c45-4825-82b8-0a67bf344e47', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6d3de5-9b34-410d-a605-f33b38803947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6d3de5-9b34-410d-a605-f33b38803947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf20518-cfb0-4e47-b2e2-1e76482858fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Volume 175c009c-5c45-4825-82b8-0a67bf344e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175c009c-5c45-4825-82b8-0a67bf344e47', 'volume_size': 1} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-438351475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175c009c-5c45-4825-82b8-0a67bf344e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8c070d658b42e58fb84a3ffdc6ba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:15Z,use_quota=True,user_id='a5155857e52b419abfdb05aaaafc4ee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Creating volume 175c009c-5c45-4825-82b8-0a67bf344e47 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:15 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ac2cb3-7b48-40c2-8cd3-81ef564559d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78605737-8a3b-4174-8821-6d3c0e71f11f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5442e100-72d9-414a-a086-e285926cd04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:15 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 1073741824 Apr 15 10:17:15 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume volume-78605737-8a3b-4174-8821-6d3c0e71f11f (78605737-8a3b-4174-8821-6d3c0e71f11f): created successfully Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5442e100-72d9-414a-a086-e285926cd04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (6c166926-33d0-493e-8c3f-1d30481d778e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-83d155bd-a0ef-40fc-9b93-65093f3ed1d1 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created volume successfully. Apr 15 10:17:15 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 1073741824" returned: 0 in 0.499s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:15 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 Apr 15 10:17:15 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:16 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47" returned: 0 in 0.469s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf20518-cfb0-4e47-b2e2-1e76482858fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175c009c-5c45-4825-82b8-0a67bf344e47', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad86451-b661-45ff-b9f3-8c8bddee8793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Volume volume-175c009c-5c45-4825-82b8-0a67bf344e47 (175c009c-5c45-4825-82b8-0a67bf344e47): created successfully Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad86451-b661-45ff-b9f3-8c8bddee8793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Flow 'volume_create_manager' (9848f439-6272-4455-81f4-300c8e830c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-579a351f-97e5-4c99-bac9-5a016914e8e8 tempest-VolumesListAdminTestJSON-939129125 None] Created volume successfully. Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Creating offline snapshot 1b87536a-75fb-42ee-ad0e-76e03d07ea34 of volume 78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c8ee19-d210-4be5-8502-568f8e9d3e98]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:16 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f Apr 15 10:17:16 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:16 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:16 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 1G Apr 15 10:17:16 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:17 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 1G" returned: 0 in 0.533s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78605737-8a3b-4174-8821-6d3c0e71f11f -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:17 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78605737-8a3b-4174-8821-6d3c0e71f11f -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 Apr 15 10:17:17 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Flow 'volume_create_manager' (64ab3105-d37f-4108-abbc-27fadec7a3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074c8628-7091-4283-a765-37808678e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074c8628-7091-4283-a765-37808678e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04548f52-7e3e-4839-a602-0d7768ce35d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be216213ff443daab15190b40b8367a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:18Z,use_quota=True,user_id='1814e428320d4fa4b9ba787c0ccda003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32ae188-8d8c-475a-97eb-c6b8bd188206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32ae188-8d8c-475a-97eb-c6b8bd188206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b81cdc-e2a5-4954-8de5-838ff4db2432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b81cdc-e2a5-4954-8de5-838ff4db2432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04548f52-7e3e-4839-a602-0d7768ce35d2', 'volume_name': 'volume-04548f52-7e3e-4839-a602-0d7768ce35d2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5649d9ba-977d-4328-afd2-958f6f89a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5649d9ba-977d-4328-afd2-958f6f89a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ff60e2-17be-44f4-adb2-5967cec1ba76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Volume 04548f52-7e3e-4839-a602-0d7768ce35d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04548f52-7e3e-4839-a602-0d7768ce35d2', 'volume_size': 1} Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:17 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78605737-8a3b-4174-8821-6d3c0e71f11f -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34" returned: 0 in 0.452s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:17 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 is being set with open permissions: ugo+rw Apr 15 10:17:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:17 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 Apr 15 10:17:17 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:18 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34" returned: 0 in 0.420s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:18 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.info Apr 15 10:17:18 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:18 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.info" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:18 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.info is being set with open permissions: ugo+rw Apr 15 10:17:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:18 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.info Apr 15 10:17:18 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:19 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.info" returned: 0 in 0.410s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04548f52-7e3e-4839-a602-0d7768ce35d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be216213ff443daab15190b40b8367a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:18Z,use_quota=True,user_id='1814e428320d4fa4b9ba787c0ccda003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Creating volume 04548f52-7e3e-4839-a602-0d7768ce35d2 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:19 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:19 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 1073741824 Apr 15 10:17:19 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-17021cea-3709-4d5e-bccc-e4f1d6152e15 tempest-CreateVolumesFromSnapshotTest-691510105 None] Create snapshot completed successfully Apr 15 10:17:19 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (d165d334-7570-447d-9084-f8c21f3a109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9014818-e5e7-49da-a313-a25bb9fb63ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9014818-e5e7-49da-a313-a25bb9fb63ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107805725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8591243e-23c5-4859-8996-279742d1fc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd0833b-b600-4119-845f-e65dae1152c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd0833b-b600-4119-845f-e65dae1152c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88a6594-cd6e-471c-a417-97643e7e497b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88a6594-cd6e-471c-a417-97643e7e497b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8591243e-23c5-4859-8996-279742d1fc3a', 'volume_name': 'volume-8591243e-23c5-4859-8996-279742d1fc3a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf24c708-294c-43cf-a8ae-da35b3427a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf24c708-294c-43cf-a8ae-da35b3427a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cad5170-2973-4558-ba22-268f1b7ba4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume 8591243e-23c5-4859-8996-279742d1fc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8591243e-23c5-4859-8996-279742d1fc3a', 'volume_size': 1} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 1073741824" returned: 0 in 0.623s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:19 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 Apr 15 10:17:19 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (b1b933ca-6a46-4c19-a323-6bca29abeec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbac4d2-1023-40b6-b64a-2cc050d8228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbbac4d2-1023-40b6-b64a-2cc050d8228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558313854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292b4229-7a3a-4f99-ab08-7d9c342cd8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7ad313-06ba-4a73-aa4b-daebc2c71b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7ad313-06ba-4a73-aa4b-daebc2c71b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cb4a2a-e0c8-4ede-a348-96d0dc99d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cb4a2a-e0c8-4ede-a348-96d0dc99d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292b4229-7a3a-4f99-ab08-7d9c342cd8ef', 'volume_name': 'volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670932e8-f04a-4320-9f17-75e7d7e268a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670932e8-f04a-4320-9f17-75e7d7e268a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984ea30d-8659-4df9-b2c2-d093639549c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume 292b4229-7a3a-4f99-ab08-7d9c342cd8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef', 'volume_size': 1} Apr 15 10:17:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (5c5b6987-2abf-4932-8d84-ec20f5060661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb465d58-7083-469c-b928-6bbc8e4cdd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb465d58-7083-469c-b928-6bbc8e4cdd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431187522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48060ba6-cd29-4bb0-ab20-d2d61ff801cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2427171-7304-45d5-a6b6-dc6ca1ad80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2427171-7304-45d5-a6b6-dc6ca1ad80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06062560-6388-49a6-8655-db8329cd6733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06062560-6388-49a6-8655-db8329cd6733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48060ba6-cd29-4bb0-ab20-d2d61ff801cb', 'volume_name': 'volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e40f78-3ca2-4156-b97f-76e134707afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e40f78-3ca2-4156-b97f-76e134707afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aa58c2-a76c-42c3-855a-1a00a7ba7bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume 48060ba6-cd29-4bb0-ab20-d2d61ff801cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb', 'volume_size': 1} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:20 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2" returned: 0 in 0.484s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1107805725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8591243e-23c5-4859-8996-279742d1fc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Creating volume 8591243e-23c5-4859-8996-279742d1fc3a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:20 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ff60e2-17be-44f4-adb2-5967cec1ba76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04548f52-7e3e-4839-a602-0d7768ce35d2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a 1073741824 Apr 15 10:17:20 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d554f5-7b04-4307-a4eb-6858cb35b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Volume volume-04548f52-7e3e-4839-a602-0d7768ce35d2 (04548f52-7e3e-4839-a602-0d7768ce35d2): created successfully Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d554f5-7b04-4307-a4eb-6858cb35b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Flow 'volume_create_manager' (64ab3105-d37f-4108-abbc-27fadec7a3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (df7721b1-6210-4092-94a3-01a489c712e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afe00bf-b19a-4591-8cd6-4dbc2b92c835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2e27d26d-306d-4998-ba47-60d42164fd5a tempest-VolumesListAdminTestJSON-1552843628 None] Created volume successfully. Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afe00bf-b19a-4591-8cd6-4dbc2b92c835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484692499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46ab603-d63e-405c-b338-6dae650c4185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b962332-0c13-4910-b58b-5d2ade0ae8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b962332-0c13-4910-b58b-5d2ade0ae8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ed19b2-9a64-46f4-8800-82fe3ea60b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ed19b2-9a64-46f4-8800-82fe3ea60b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46ab603-d63e-405c-b338-6dae650c4185', 'volume_name': 'volume-e46ab603-d63e-405c-b338-6dae650c4185', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28fe125-7522-461b-bb0d-97cc91e947e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28fe125-7522-461b-bb0d-97cc91e947e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f489e5a-fd9d-4c61-a1b1-55ef8d481071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume e46ab603-d63e-405c-b338-6dae650c4185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46ab603-d63e-405c-b338-6dae650c4185', 'volume_size': 1} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (9327c661-a7bc-4e8d-8970-88c040faec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e54bf15-dc10-4e35-b752-20d2e2edda59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e54bf15-dc10-4e35-b752-20d2e2edda59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948656259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7de8eb-d679-49ee-8c67-e278d89d5fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ca836f-35ce-4ce6-bfb0-6f150be34c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ca836f-35ce-4ce6-bfb0-6f150be34c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35449927-35a6-4fe6-9e2d-b7d1aafbc337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35449927-35a6-4fe6-9e2d-b7d1aafbc337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7de8eb-d679-49ee-8c67-e278d89d5fe4', 'volume_name': 'volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f5591-3b10-4a7e-9707-a26efea98f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f5591-3b10-4a7e-9707-a26efea98f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d04fec-d0e4-4565-a56b-b75ebcfac470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:20 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume 9b7de8eb-d679-49ee-8c67-e278d89d5fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4', 'volume_size': 1} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Acquiring lock "cinder-04548f52-7e3e-4839-a602-0d7768ce35d2-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Lock "cinder-04548f52-7e3e-4839-a602-0d7768ce35d2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:20 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Acquiring lock "cinder-quobyte-04548f52-7e3e-4839-a602-0d7768ce35d2" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a 1073741824" returned: 0 in 0.624s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Lock "cinder-quobyte-04548f52-7e3e-4839-a602-0d7768ce35d2" acquired by "delete_volume" :: waited 0.023s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e51cb76-d75e-49e1-942d-9f0260336a44]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:20 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a Apr 15 10:17:20 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "cinder-175c009c-5c45-4825-82b8-0a67bf344e47-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-175c009c-5c45-4825-82b8-0a67bf344e47-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:20 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 Apr 15 10:17:20 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "cinder-quobyte-175c009c-5c45-4825-82b8-0a67bf344e47" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-quobyte-175c009c-5c45-4825-82b8-0a67bf344e47" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feb7f00-4645-4ba2-9ff0-a575dcdeb1ac]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:21 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 Apr 15 10:17:21 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:21 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558313854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292b4229-7a3a-4f99-ab08-7d9c342cd8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Creating volume 292b4229-7a3a-4f99-ab08-7d9c342cd8ef {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:21 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cad5170-2973-4558-ba22-268f1b7ba4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8591243e-23c5-4859-8996-279742d1fc3a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6577afe6-e893-427a-8389-85d098f3c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:21 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef 1073741824 Apr 15 10:17:21 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:21 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume volume-8591243e-23c5-4859-8996-279742d1fc3a (8591243e-23c5-4859-8996-279742d1fc3a): created successfully Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6577afe6-e893-427a-8389-85d098f3c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:21 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (d165d334-7570-447d-9084-f8c21f3a109b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2" returned: 0 in 0.536s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-82b89ded-dce8-4d3c-8a40-a79b75e387fd tempest-CreateVolumesFromSnapshotTest-691510105 None] Created volume successfully. Apr 15 10:17:21 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2 Apr 15 10:17:21 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:21 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47" returned: 0 in 0.533s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:21 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47 Apr 15 10:17:21 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:21 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-04548f52-7e3e-4839-a602-0d7768ce35d2" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Lock "cinder-quobyte-04548f52-7e3e-4839-a602-0d7768ce35d2" released by "delete_volume" :: held 1.034s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:21 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef 1073741824" returned: 0 in 0.559s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Created reservations ['7ffee039-9169-4876-9712-fc5317517727', '3262153a-0a51-41ab-8523-d8cb9be3d405', '439c1399-5570-4654-b3e1-f32c510fc662', '84b82a66-026b-4ea1-a705-597b3028aa56'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:22 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:22 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:22 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-175c009c-5c45-4825-82b8-0a67bf344e47" returned: 0 in 0.479s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-quobyte-175c009c-5c45-4825-82b8-0a67bf344e47" released by "delete_volume" :: held 1.045s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:22 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:22 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Created reservations ['da45d5cb-1138-4cb0-8d4e-8ef7f71dd13e', '68545404-50c9-4aca-a810-77f814e00d8c', 'c15c0cc0-3069-47a0-8e5b-983cb11ee135', '1e249efa-98ad-445a-8e4a-b0c97fdc4535'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:22 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:22 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:22 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:22 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431187522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48060ba6-cd29-4bb0-ab20-d2d61ff801cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Creating volume 48060ba6-cd29-4bb0-ab20-d2d61ff801cb {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:22 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984ea30d-8659-4df9-b2c2-d093639549c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:22 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb 1073741824 Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b85eed-4ffd-4d39-8e6c-a8f50ff91a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:22 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Deleted volume successfully. Apr 15 10:17:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef (292b4229-7a3a-4f99-ab08-7d9c342cd8ef): created successfully Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b85eed-4ffd-4d39-8e6c-a8f50ff91a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (b1b933ca-6a46-4c19-a323-6bca29abeec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-698eb5c0-b59b-4915-9d70-e5a516bc80b3 tempest-VolumesListAdminTestJSON-1552843628 None] Lock "cinder-04548f52-7e3e-4839-a602-0d7768ce35d2-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7ba00c94-4b8e-4a2d-9fe2-cabc60645061 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created volume successfully. Apr 15 10:17:22 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.493s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Deleted volume successfully. Apr 15 10:17:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-03f543d8-bfa9-411e-8143-b913b75529c2 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-175c009c-5c45-4825-82b8-0a67bf344e47-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:23 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb 1073741824" returned: 0 in 0.520s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:23 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb Apr 15 10:17:23 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "cinder-5af3e1db-d4e9-4e55-af25-7199d4ee66ad-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-5af3e1db-d4e9-4e55-af25-7199d4ee66ad-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "cinder-quobyte-5af3e1db-d4e9-4e55-af25-7199d4ee66ad" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-quobyte-5af3e1db-d4e9-4e55-af25-7199d4ee66ad" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710168a-aa5e-40c5-a7e4-79e7b3f4ff12]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:23 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad Apr 15 10:17:23 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:23 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb" returned: 0 in 0.460s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.120s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484692499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46ab603-d63e-405c-b338-6dae650c4185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Creating volume e46ab603-d63e-405c-b338-6dae650c4185 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:23 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6aa58c2-a76c-42c3-855a-1a00a7ba7bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19dddff5-d9e3-4859-b58a-bc1afbb85ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:23 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 1073741824 Apr 15 10:17:23 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb (48060ba6-cd29-4bb0-ab20-d2d61ff801cb): created successfully Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19dddff5-d9e3-4859-b58a-bc1afbb85ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (5c5b6987-2abf-4932-8d84-ec20f5060661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6cac1d8a-2420-408c-a3ee-2dc6fd968db8 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created volume successfully. Apr 15 10:17:23 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad" returned: 0 in 0.513s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:23 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad Apr 15 10:17:23 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:24 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 1073741824" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:24 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 Apr 15 10:17:24 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:24 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5af3e1db-d4e9-4e55-af25-7199d4ee66ad" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-quobyte-5af3e1db-d4e9-4e55-af25-7199d4ee66ad" released by "delete_volume" :: held 0.993s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Created reservations ['998299dd-e3a1-4eca-b99b-888ac87778a4', '8aaa213d-ee28-4e02-b712-d58fb0bcca9a', '54d21471-0012-49e6-bd15-b6e002854dca', 'ddbc78f4-11eb-42ec-a076-62e0500658a1'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:24 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:24 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:24 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185" returned: 0 in 0.442s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.946s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-948656259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7de8eb-d679-49ee-8c67-e278d89d5fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb1734154694651bcb224c7f60eca52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:20Z,use_quota=True,user_id='99b37bc084ee4400a1fdc66563b1f43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Creating volume 9b7de8eb-d679-49ee-8c67-e278d89d5fe4 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:24 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f489e5a-fd9d-4c61-a1b1-55ef8d481071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46ab603-d63e-405c-b338-6dae650c4185', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802dcb98-94a6-4439-bb7f-e04883e465a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:24 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 1073741824 Apr 15 10:17:24 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume volume-e46ab603-d63e-405c-b338-6dae650c4185 (e46ab603-d63e-405c-b338-6dae650c4185): created successfully Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802dcb98-94a6-4439-bb7f-e04883e465a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (df7721b1-6210-4092-94a3-01a489c712e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1e61f11c-9056-4b6a-8a2b-aead9ad99b6c tempest-CreateVolumesFromSnapshotTest-691510105 None] Created volume successfully. Apr 15 10:17:24 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.427s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Deleted volume successfully. Apr 15 10:17:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-e7f289da-2660-4c88-9bcb-476d9cc2c248 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-5af3e1db-d4e9-4e55-af25-7199d4ee66ad-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:25 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 1073741824" returned: 0 in 0.518s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:25 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 Apr 15 10:17:25 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "cinder-590d8ce8-bac1-49b2-8538-852f78cad60b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-590d8ce8-bac1-49b2-8538-852f78cad60b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:25 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "cinder-quobyte-590d8ce8-bac1-49b2-8538-852f78cad60b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4" returned: 0 in 0.448s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-quobyte-590d8ce8-bac1-49b2-8538-852f78cad60b" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d04fec-d0e4-4565-a56b-b75ebcfac470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1a99b3-6acc-476b-bd78-f6571fc58921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[615ec57c-a979-4833-9475-c6597513574a]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Volume volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 (9b7de8eb-d679-49ee-8c67-e278d89d5fe4): created successfully Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da1a99b3-6acc-476b-bd78-f6571fc58921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Flow 'volume_create_manager' (9327c661-a7bc-4e8d-8970-88c040faec79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6db89dec-cbf6-452f-b535-a1b69f7ee467 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created volume successfully. Apr 15 10:17:25 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b Apr 15 10:17:25 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-9b7de8eb-d679-49ee-8c67-e278d89d5fe4-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-9b7de8eb-d679-49ee-8c67-e278d89d5fe4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-9b7de8eb-d679-49ee-8c67-e278d89d5fe4" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-9b7de8eb-d679-49ee-8c67-e278d89d5fe4" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:26 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b" returned: 0 in 0.526s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fcb42c-ff21-4d85-bb51-75c0f925e2ae]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:26 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b Apr 15 10:17:26 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:26 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 Apr 15 10:17:26 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:26 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-590d8ce8-bac1-49b2-8538-852f78cad60b" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-quobyte-590d8ce8-bac1-49b2-8538-852f78cad60b" released by "delete_volume" :: held 1.039s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:26 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Created reservations ['2163231b-bf96-4f0e-86ad-fbc626aad5ce', '33f15d6c-3f92-44c0-b3b0-803ac0e924c4', '91e94bcb-4669-44d0-8d3f-a4a1073a9134', '330ab496-b6e8-4198-8421-02d28d10670a'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4" returned: 0 in 0.515s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:26 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4 Apr 15 10:17:26 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:26 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:26 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:27 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9b7de8eb-d679-49ee-8c67-e278d89d5fe4" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-9b7de8eb-d679-49ee-8c67-e278d89d5fe4" released by "delete_volume" :: held 0.994s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Created reservations ['8fb525e1-cdcd-455b-b951-88663976ae8f', 'f275cb3e-01c5-477e-a8e2-9020b7a9db0b', '3988c3ed-233f-4a02-8737-16e602353f13', 'ab0cd7ae-c0ed-4fa3-9c56-6ba1e393f8dc'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:27 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Deleted volume successfully. Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-052a2343-743c-4add-b3e4-497d2c474a49 tempest-VolumesListAdminTestJSON-939129125 None] Lock "cinder-590d8ce8-bac1-49b2-8538-852f78cad60b-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:27 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:27 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:27 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.443s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Deleted volume successfully. Apr 15 10:17:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-95efd298-740e-47de-969c-b4e6301cf0bd tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-9b7de8eb-d679-49ee-8c67-e278d89d5fe4-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-e46ab603-d63e-405c-b338-6dae650c4185-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-e46ab603-d63e-405c-b338-6dae650c4185-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-e46ab603-d63e-405c-b338-6dae650c4185" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-e46ab603-d63e-405c-b338-6dae650c4185" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4730a3-8b3e-4020-b7b5-7772dd9de761]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:28 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 Apr 15 10:17:28 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:28 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185" returned: 0 in 0.544s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:28 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185 Apr 15 10:17:28 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:29 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-e46ab603-d63e-405c-b338-6dae650c4185" returned: 0 in 0.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-e46ab603-d63e-405c-b338-6dae650c4185" released by "delete_volume" :: held 1.108s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created reservations ['62b76067-d12d-416e-9c44-5724570a55a1', 'd77d19a7-ef96-4710-a0ac-dc47c57ca4fe', 'c6afb0f3-988e-4233-8668-d34e57740579', 'f7c27169-b565-46a0-8e07-d5d6e971f79f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:29 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:29 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:29 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:29 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Deleted volume successfully. Apr 15 10:17:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-cce1e46a-c323-40c3-a223-4112ce69a939 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-e46ab603-d63e-405c-b338-6dae650c4185-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Flow 'volume_create_manager' (c0b5e3f0-73e5-43d8-ae31-0303583d959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e52cf-25fb-485e-a5bc-02b315eeac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e52cf-25fb-485e-a5bc-02b315eeac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1578434470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e5fa6b-1eb4-4f4f-b132-04527eb091d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08449ba11e76440f813bf0614f0ab556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:30Z,use_quota=True,user_id='95b29b3a41df48bb95a9ff9bed55534a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd831af-fedb-4738-9895-c563ecec5d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd831af-fedb-4738-9895-c563ecec5d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11ed104-750d-43e8-9695-70f0568e51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11ed104-750d-43e8-9695-70f0568e51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e5fa6b-1eb4-4f4f-b132-04527eb091d3', 'volume_name': 'volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4641e21-02f6-475d-8afe-7ec3688f0c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4641e21-02f6-475d-8afe-7ec3688f0c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5db31-abca-4845-8659-3f3b69fdf641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:30 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Volume f6e5fa6b-1eb4-4f4f-b132-04527eb091d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3', 'volume_size': 1} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1578434470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e5fa6b-1eb4-4f4f-b132-04527eb091d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08449ba11e76440f813bf0614f0ab556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:30Z,use_quota=True,user_id='95b29b3a41df48bb95a9ff9bed55534a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Creating volume f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:30 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:30 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 1073741824 Apr 15 10:17:30 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-48060ba6-cd29-4bb0-ab20-d2d61ff801cb-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-48060ba6-cd29-4bb0-ab20-d2d61ff801cb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-48060ba6-cd29-4bb0-ab20-d2d61ff801cb" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-48060ba6-cd29-4bb0-ab20-d2d61ff801cb" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72c7331-f83e-47d4-a7ab-3374cc49b72c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:30 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb Apr 15 10:17:30 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:30 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 1073741824" returned: 0 in 0.549s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:30 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 Apr 15 10:17:30 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:30 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb" returned: 0 in 0.511s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:30 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb Apr 15 10:17:30 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:31 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5db31-abca-4845-8659-3f3b69fdf641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c766792a-8d76-49cc-b7df-d14fed1abc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:31 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Volume volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 (f6e5fa6b-1eb4-4f4f-b132-04527eb091d3): created successfully Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c766792a-8d76-49cc-b7df-d14fed1abc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Flow 'volume_create_manager' (c0b5e3f0-73e5-43d8-ae31-0303583d959f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-73222943-587a-46ce-aea4-a8d59cbe808e tempest-SnapshotMetadataTestJSON-1919264234 None] Created volume successfully. Apr 15 10:17:31 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-48060ba6-cd29-4bb0-ab20-d2d61ff801cb" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-48060ba6-cd29-4bb0-ab20-d2d61ff801cb" released by "delete_volume" :: held 1.014s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created reservations ['f78f39d3-bef3-40c4-bfb1-19109f5a1201', 'd51c2546-8300-49cd-8e6f-0cd95185ba7b', '8e56e6ae-6302-4b8d-8bd8-7429483294c4', '6d9e494c-6acd-4acf-b339-b33d9aad73b5'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:31 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:31 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:31 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:31 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Deleted volume successfully. Apr 15 10:17:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6533d9a2-ad3e-4687-b99f-32eedf8acba4 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-48060ba6-cd29-4bb0-ab20-d2d61ff801cb-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Creating offline snapshot e856e4b9-4f84-490c-af92-3eb7b4a71a98 of volume f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6452440a-b16e-4417-bf80-3bd136b7b6d1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-292b4229-7a3a-4f99-ab08-7d9c342cd8ef-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-292b4229-7a3a-4f99-ab08-7d9c342cd8ef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:32 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 Apr 15 10:17:32 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-292b4229-7a3a-4f99-ab08-7d9c342cd8ef" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-292b4229-7a3a-4f99-ab08-7d9c342cd8ef" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d979db9-2fe7-403b-8874-e0430c1ddad9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:32 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef Apr 15 10:17:32 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:32 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:33 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 1G Apr 15 10:17:33 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:33 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef" returned: 0 in 0.505s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:33 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef Apr 15 10:17:33 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:33 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:33 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:33 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 1G" returned: 0 in 0.528s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:33 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 Apr 15 10:17:33 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:33 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-292b4229-7a3a-4f99-ab08-7d9c342cd8ef" returned: 0 in 0.486s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-292b4229-7a3a-4f99-ab08-7d9c342cd8ef" released by "delete_volume" :: held 1.013s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Created reservations ['47055608-e1cc-4f84-921b-8886a097a3e5', '0d1f40ea-a48a-4364-a051-b84605ea146b', '19bbe5f5-a07c-4c85-a782-fedaf35976a6', '716a4c36-079e-4a9e-badb-0af262a72657'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:33 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:33 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:33 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.466s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-8591243e-23c5-4859-8996-279742d1fc3a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-8591243e-23c5-4859-8996-279742d1fc3a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-8591243e-23c5-4859-8996-279742d1fc3a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-8591243e-23c5-4859-8996-279742d1fc3a" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9832b65-a90e-4de7-a3bf-4b43d7869fab]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:34 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a Apr 15 10:17:34 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:34 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98" returned: 0 in 0.529s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:34 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 is being set with open permissions: ugo+rw Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:34 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 Apr 15 10:17:34 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:34 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.515s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Deleted volume successfully. Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-517d4b9c-2e84-4904-abb4-5e9a5c52934d tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-292b4229-7a3a-4f99-ab08-7d9c342cd8ef-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:34 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a" returned: 0 in 0.523s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:34 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98" returned: 0 in 0.448s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:34 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a Apr 15 10:17:34 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:34 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.info Apr 15 10:17:34 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:34 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8591243e-23c5-4859-8996-279742d1fc3a" returned: 0 in 0.441s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-8591243e-23c5-4859-8996-279742d1fc3a" released by "delete_volume" :: held 0.989s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:34 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.info" returned: 0 in 0.435s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:34 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.info is being set with open permissions: ugo+rw Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:34 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created reservations ['830facad-3e96-4e93-8d85-5ef0b374f33c', '175f1c92-f425-4090-af53-5cbeadbd1ec8', 'c634717c-67a9-4758-8aca-3cbc8db1c0e8', '8bf47399-af67-4c3f-b3d7-dd7c6467f395'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:34 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.info Apr 15 10:17:34 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:35 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:35 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:35 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.info" returned: 0 in 0.434s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-62a81071-22fb-4144-8f37-6e08be502c42 tempest-SnapshotMetadataTestJSON-1919264234 None] Create snapshot completed successfully Apr 15 10:17:35 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.416s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:35 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Deleted volume successfully. Apr 15 10:17:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7dae4fd0-4f9e-4381-987f-a1b13d442761 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-8591243e-23c5-4859-8996-279742d1fc3a-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-1b87536a-75fb-42ee-ad0e-76e03d07ea34-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "cinder-e856e4b9-4f84-490c-af92-3eb7b4a71a98-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-e856e4b9-4f84-490c-af92-3eb7b4a71a98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "cinder-quobyte-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-1b87536a-75fb-42ee-ad0e-76e03d07ea34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-78605737-8a3b-4174-8821-6d3c0e71f11f" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-quobyte-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "cinder-quobyte-e856e4b9-4f84-490c-af92-3eb7b4a71a98" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-78605737-8a3b-4174-8821-6d3c0e71f11f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-1b87536a-75fb-42ee-ad0e-76e03d07ea34" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-quobyte-e856e4b9-4f84-490c-af92-3eb7b4a71a98" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Deleting offline snapshot e856e4b9-4f84-490c-af92-3eb7b4a71a98 of volume f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] snapshot_file for this snap is: volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-1b87536a-75fb-42ee-ad0e-76e03d07ea34" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Deleting offline snapshot 1b87536a-75fb-42ee-ad0e-76e03d07ea34 of volume 78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] snapshot_file for this snap is: volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c660bba4-db1d-4cac-a290-2b0cde986edd]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9809b92-9d2b-4269-97ab-ef444a363dd3]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:36 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 Apr 15 10:17:36 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:36 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 Apr 15 10:17:36 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:36 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98" returned: 0 in 0.502s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9707b910-d089-4048-b765-7df2d79b7d59]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:36 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34" returned: 0 in 0.526s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78605737-8a3b-4174-8821-6d3c0e71f11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51f2cb-c928-4dbb-95a5-1af6d23d71d5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:36 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 Apr 15 10:17:36 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:36 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f Apr 15 10:17:36 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:37 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:37 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f" returned: 0 in 0.512s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" returned: 0 in 0.554s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:37 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 Apr 15 10:17:37 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:37 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 Apr 15 10:17:37 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:37 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98" returned: 0 in 0.472s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:37 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98 Apr 15 10:17:37 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:37 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34" returned: 0 in 0.524s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:37 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34 Apr 15 10:17:37 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:38 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3.e856e4b9-4f84-490c-af92-3eb7b4a71a98" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-quobyte-e856e4b9-4f84-490c-af92-3eb7b4a71a98" released by "_delete_snapshot" :: held 2.050s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-quobyte-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" released by "delete_snapshot" :: held 2.069s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:38 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f.1b87536a-75fb-42ee-ad0e-76e03d07ea34" returned: 0 in 0.442s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-1b87536a-75fb-42ee-ad0e-76e03d07ea34" released by "_delete_snapshot" :: held 2.076s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-78605737-8a3b-4174-8821-6d3c0e71f11f" released by "delete_snapshot" :: held 2.103s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Created reservations ['87d22f04-0507-46b4-b41c-3a8778778f8c', '4b85e300-899a-4735-95cf-d1bdf0962052', '53b514c5-2e50-4392-94cc-09346288d902', '44f728f6-c5bd-4310-bad5-0a07dd242846'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created reservations ['abed9575-6743-4c68-b118-118d34c7e6f7', '2e7865ab-a6db-425d-b536-6509f396ab20', 'b213947b-61bd-43ae-b463-0bc1c5ca047f', '7e3b59a4-fc22-491c-b5d7-02b3d513d5ff'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Delete snapshot completed successfully. Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ada3d02-bc37-476a-a4f9-a56602a34508 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-e856e4b9-4f84-490c-af92-3eb7b4a71a98-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Delete snapshot completed successfully. Apr 15 10:17:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-001a1a56-0507-4299-8102-071848027df5 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-1b87536a-75fb-42ee-ad0e-76e03d07ea34-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-78605737-8a3b-4174-8821-6d3c0e71f11f-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-78605737-8a3b-4174-8821-6d3c0e71f11f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "cinder-quobyte-78605737-8a3b-4174-8821-6d3c0e71f11f" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-78605737-8a3b-4174-8821-6d3c0e71f11f" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "cinder-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[605b0180-ae8c-481c-8ae9-849ce1bed0dc]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "cinder-quobyte-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-quobyte-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d69bb30-9495-46c6-a920-382ed6124446]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:39 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f Apr 15 10:17:39 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:39 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 Apr 15 10:17:39 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:39 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f" returned: 0 in 0.521s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:39 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f Apr 15 10:17:39 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:39 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" returned: 0 in 0.516s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:39 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3 Apr 15 10:17:39 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:40 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-78605737-8a3b-4174-8821-6d3c0e71f11f" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-quobyte-78605737-8a3b-4174-8821-6d3c0e71f11f" released by "delete_volume" :: held 1.016s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Created reservations ['480a3d68-c4bd-41bb-a878-1a2b756b2b21', '2b204be7-f553-4488-aabd-8457fde84dd6', '34434045-fd53-4aae-9416-055a11053ce3', 'b6072197-65d6-4b29-9c01-5964f85550ad'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:40 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" returned: 0 in 0.454s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-quobyte-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3" released by "delete_volume" :: held 1.005s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:40 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:40 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Created reservations ['6d544cf5-1711-4abf-918b-df169af7bfcf', 'dfe2a8fd-a4d8-46e9-a306-ebb590132f5e', '2d6a05a5-b72f-405c-94dd-8357ed259797', 'd60da8b7-bcbc-4ebb-a93d-a12547082295'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:40 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:17:40 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:40 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.447s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Deleted volume successfully. Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2302fdd7-7799-4bec-90a9-f62bccfcbe08 tempest-CreateVolumesFromSnapshotTest-691510105 None] Lock "cinder-78605737-8a3b-4174-8821-6d3c0e71f11f-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:40 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.420s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:17:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Deleted volume successfully. Apr 15 10:17:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3f5e06d5-7603-4a7d-9599-944e91d48168 tempest-SnapshotMetadataTestJSON-1919264234 None] Lock "cinder-f6e5fa6b-1eb4-4f4f-b132-04527eb091d3-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Flow 'volume_create_manager' (f47a282b-86aa-4d24-8c83-753d3825633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f611bc1d-4a6d-4df0-af79-8f286aa6104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f611bc1d-4a6d-4df0-af79-8f286aa6104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-36143668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335cfd51-0733-43dc-80bc-7cb55a642d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3616d131ec4796bd70738a4f59b183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:43Z,use_quota=True,user_id='0b6afa40b853488e9092e91318bbf3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be906dfb-9480-48f8-ac30-c24e292e0e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be906dfb-9480-48f8-ac30-c24e292e0e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d88795-03cc-458e-88e5-0f952f303a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d88795-03cc-458e-88e5-0f952f303a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335cfd51-0733-43dc-80bc-7cb55a642d07', 'volume_name': 'volume-335cfd51-0733-43dc-80bc-7cb55a642d07', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13836f2-59eb-4992-80ea-bafe8d4179c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13836f2-59eb-4992-80ea-bafe8d4179c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eaed687-2051-4e67-9a22-c9376974dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:43 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Volume 335cfd51-0733-43dc-80bc-7cb55a642d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335cfd51-0733-43dc-80bc-7cb55a642d07', 'volume_size': 1} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-36143668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335cfd51-0733-43dc-80bc-7cb55a642d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3616d131ec4796bd70738a4f59b183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:17:43Z,use_quota=True,user_id='0b6afa40b853488e9092e91318bbf3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Creating volume 335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:17:43 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:43 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 1073741824 Apr 15 10:17:43 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:43 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 1073741824" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:44 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 Apr 15 10:17:44 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:44 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07" returned: 0 in 0.439s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eaed687-2051-4e67-9a22-c9376974dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335cfd51-0733-43dc-80bc-7cb55a642d07', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5c41c1-10bd-4777-9d04-43d8068f95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:17:44 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Volume volume-335cfd51-0733-43dc-80bc-7cb55a642d07 (335cfd51-0733-43dc-80bc-7cb55a642d07): created successfully Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f5c41c1-10bd-4777-9d04-43d8068f95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:17:44 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Flow 'volume_create_manager' (f47a282b-86aa-4d24-8c83-753d3825633b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:17:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cbf7f57e-6cbd-4b3e-8a11-6d1c4145356d tempest-VolumesSnapshotListTestJSON-703356555 None] Created volume successfully. Apr 15 10:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Creating offline snapshot 396b30fd-bee6-4bce-8659-419f442212f7 of volume 335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:17:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[888eafb2-a686-484c-a117-175bad44e9fe]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:45 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 Apr 15 10:17:45 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:46 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07" returned: 0 in 0.525s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:46 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 1G Apr 15 10:17:46 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:46 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 1G" returned: 0 in 0.517s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:46 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 Apr 15 10:17:46 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:47 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7" returned: 0 in 0.442s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:47 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 is being set with open permissions: ugo+rw Apr 15 10:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:47 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 Apr 15 10:17:47 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:47 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7" returned: 0 in 0.406s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:47 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.info Apr 15 10:17:47 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:48 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.info" returned: 0 in 0.429s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:48 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.info is being set with open permissions: ugo+rw Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:48 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.info Apr 15 10:17:48 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:48 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.info" returned: 0 in 0.440s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4a799873-fc44-41de-b7c4-6263854e6160 tempest-VolumesSnapshotListTestJSON-703356555 None] Create snapshot completed successfully Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Creating offline snapshot 3b4cbee6-da62-4b3d-aef2-09059b3db366 of volume 335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9bf520-17c7-4058-838b-a19cbf160743]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:49 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 Apr 15 10:17:49 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:49 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335cfd51-0733-43dc-80bc-7cb55a642d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:49 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 1G Apr 15 10:17:49 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:49 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 1G" returned: 0 in 0.495s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:49 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 Apr 15 10:17:49 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:50 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:50 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 is being set with open permissions: ugo+rw Apr 15 10:17:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:50 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 Apr 15 10:17:50 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:50 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366" returned: 0 in 0.502s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2171e6e6-b212-403a-b730-4c9d8d760542 tempest-VolumesSnapshotListTestJSON-703356555 None] Create snapshot completed successfully Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Creating offline snapshot 79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 of volume 335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72b1079-8cd8-468c-9122-1f81863b1ef9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:52 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 Apr 15 10:17:52 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:52 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366" returned: 0 in 0.488s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335cfd51-0733-43dc-80bc-7cb55a642d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:52 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 1G Apr 15 10:17:52 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:53 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 1G" returned: 0 in 0.539s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:53 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 Apr 15 10:17:53 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:53 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" returned: 0 in 0.422s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:53 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 is being set with open permissions: ugo+rw Apr 15 10:17:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:53 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 Apr 15 10:17:53 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:54 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" returned: 0 in 0.401s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:17:54 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1bb18748-6dbd-42dd-9654-6781d308023e tempest-VolumesSnapshotListTestJSON-703356555 None] Create snapshot completed successfully Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-79a0cb8f-d757-4cce-9d05-9fb2f70c6d43-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-79a0cb8f-d757-4cce-9d05-9fb2f70c6d43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-quobyte-79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Deleting offline snapshot 79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 of volume 335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] snapshot_file for this snap is: volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d3c0e-5bb1-4cea-a170-c254ae25e661]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:54 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 Apr 15 10:17:54 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:55 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" returned: 0 in 0.482s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335cfd51-0733-43dc-80bc-7cb55a642d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:55 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d7f923-5e7d-480f-ac70-124296b0ba19]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:55 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 Apr 15 10:17:55 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:55 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335cfd51-0733-43dc-80bc-7cb55a642d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:55 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 Apr 15 10:17:55 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:56 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" returned: 0 in 0.501s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:56 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43 Apr 15 10:17:56 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:56 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" returned: 0 in 0.436s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-79a0cb8f-d757-4cce-9d05-9fb2f70c6d43" released by "_delete_snapshot" :: held 1.941s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" released by "delete_snapshot" :: held 1.962s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=128,cinder:DELETE=16,cinder:UPDATE=177,cinder:INSERT=36 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=119,cinder:UPDATE=151,cinder:INSERT=44,cinder:DELETE=15 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Created reservations ['474a061e-8b2d-4177-9810-41175d2c4303', '5c9cf566-77f6-4ff9-a305-7f7ff744482e', '824f8e77-4a27-4dce-a89c-a5e930c71d76', '72178137-6db8-414c-9b1e-ff0dac02fbb4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Delete snapshot completed successfully. Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6d4d2c4c-7870-4d60-998f-0af280896a8f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-79a0cb8f-d757-4cce-9d05-9fb2f70c6d43-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-3b4cbee6-da62-4b3d-aef2-09059b3db366-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-3b4cbee6-da62-4b3d-aef2-09059b3db366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-quobyte-3b4cbee6-da62-4b3d-aef2-09059b3db366" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-3b4cbee6-da62-4b3d-aef2-09059b3db366" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Deleting offline snapshot 3b4cbee6-da62-4b3d-aef2-09059b3db366 of volume 335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] snapshot_file for this snap is: volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8ed0f8-5c1d-4ea9-9253-7f3c9dfa2cad]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:57 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 Apr 15 10:17:57 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:57 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335cfd51-0733-43dc-80bc-7cb55a642d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ed2b6-cd91-4ffd-ab0d-0dee250b6ecd]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:57 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 Apr 15 10:17:57 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:57 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7" returned: 0 in 0.462s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:57 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335cfd51-0733-43dc-80bc-7cb55a642d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:57 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 Apr 15 10:17:57 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:58 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:58 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366 Apr 15 10:17:58 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:58 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.3b4cbee6-da62-4b3d-aef2-09059b3db366" returned: 0 in 0.421s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-3b4cbee6-da62-4b3d-aef2-09059b3db366" released by "_delete_snapshot" :: held 1.883s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" released by "delete_snapshot" :: held 1.901s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:58 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Created reservations ['050f269f-41f3-4236-988e-70fa6c88eab8', '5cbcb431-8a08-432d-9433-cd0966a6ec07', '4331f10b-5f32-40a8-bdbb-f54f40d20df2', '92b5e34c-4292-4129-a6c9-612cd7550da6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:17:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Delete snapshot completed successfully. Apr 15 10:17:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-580fd6d4-7fef-4c71-9550-6a6f4ce3068e tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-3b4cbee6-da62-4b3d-aef2-09059b3db366-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-396b30fd-bee6-4bce-8659-419f442212f7-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-396b30fd-bee6-4bce-8659-419f442212f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-quobyte-396b30fd-bee6-4bce-8659-419f442212f7" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-396b30fd-bee6-4bce-8659-419f442212f7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Deleting offline snapshot 396b30fd-bee6-4bce-8659-419f442212f7 of volume 335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] snapshot_file for this snap is: volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec5180a-33e1-49fe-be9d-c4393a72193b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:59 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 Apr 15 10:17:59 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:17:59 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7" returned: 0 in 0.478s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-335cfd51-0733-43dc-80bc-7cb55a642d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[428cd4c9-766a-4d2f-8427-d800bcd54632]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:17:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:17:59 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 Apr 15 10:17:59 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:00 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:00 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 Apr 15 10:18:00 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:00 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7" returned: 0 in 0.454s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:00 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7 Apr 15 10:18:00 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:00 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07.396b30fd-bee6-4bce-8659-419f442212f7" returned: 0 in 0.416s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-396b30fd-bee6-4bce-8659-419f442212f7" released by "_delete_snapshot" :: held 1.867s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" released by "delete_snapshot" :: held 1.879s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Created reservations ['8a1f8ef4-30ba-4e01-816a-aa63adb4243d', 'a4f240b4-6a9f-4d90-816e-af7cd8111a9c', 'e12f97df-20fa-4b47-b17d-c99da8660b93', 'b9f1783c-71ce-47f2-914f-e0e6367355bd'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:01 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Delete snapshot completed successfully. Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-044ecd9d-dc9e-42b4-bde4-7384b27840a3 tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-396b30fd-bee6-4bce-8659-419f442212f7-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-335cfd51-0733-43dc-80bc-7cb55a642d07-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-335cfd51-0733-43dc-80bc-7cb55a642d07-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[30659028-7fee-4fa4-8b17-63fa1446e8ab]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:01 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 Apr 15 10:18:01 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:01 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07" returned: 0 in 0.471s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:01 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07 Apr 15 10:18:01 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:02 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-335cfd51-0733-43dc-80bc-7cb55a642d07" returned: 0 in 0.410s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-quobyte-335cfd51-0733-43dc-80bc-7cb55a642d07" released by "delete_volume" :: held 0.916s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Created reservations ['9d5033fb-45f2-4c20-9e6a-e9ebccd03708', '7cc74062-08c3-4e35-b3c3-e259008a554f', '5a593136-6eb3-4a72-b159-874483f1730f', '45714e9b-e4cc-487d-9035-a2e352d99869'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:02 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:02 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:02 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.463s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:02 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Deleted volume successfully. Apr 15 10:18:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-dae348f8-41e6-482b-9571-b32d18ed4c2f tempest-VolumesSnapshotListTestJSON-703356555 None] Lock "cinder-335cfd51-0733-43dc-80bc-7cb55a642d07-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Flow 'volume_create_manager' (9f01f875-76ca-4ce8-83e1-5c17c25a7a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2b4e8c-b869-499d-aea2-5e6fb136a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2b4e8c-b869-499d-aea2-5e6fb136a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-904954668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d46c9fa-cf50-402c-9cf1-f0097f14cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5745254d412a4c2d88632c4af472860b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:04Z,use_quota=True,user_id='b33c1e2f7abf4608b8598d74e8ccdf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8f82e7-215c-4450-b08c-2ce2a522c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac8f82e7-215c-4450-b08c-2ce2a522c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7210629-1f17-4cd8-8429-68667092bbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7210629-1f17-4cd8-8429-68667092bbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d46c9fa-cf50-402c-9cf1-f0097f14cfa6', 'volume_name': 'volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022a4c6f-5ae0-4edf-a3e3-1b3d03c7e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022a4c6f-5ae0-4edf-a3e3-1b3d03c7e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0c2405-5f72-44d0-bde2-f87a38708199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:04 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Volume 9d46c9fa-cf50-402c-9cf1-f0097f14cfa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6', 'volume_size': 2} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-904954668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d46c9fa-cf50-402c-9cf1-f0097f14cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5745254d412a4c2d88632c4af472860b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:04Z,use_quota=True,user_id='b33c1e2f7abf4608b8598d74e8ccdf6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Creating volume 9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:04 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 2147483648 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:04 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 2147483648 Apr 15 10:18:04 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:04 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 2147483648" returned: 0 in 0.490s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:04 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 Apr 15 10:18:04 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:05 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" returned: 0 in 0.406s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0c2405-5f72-44d0-bde2-f87a38708199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6', 'volume_size': 2}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dc9f15-2546-4a54-8d1a-32cf288f3b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Volume volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 (9d46c9fa-cf50-402c-9cf1-f0097f14cfa6): created successfully Apr 15 10:18:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dc9f15-2546-4a54-8d1a-32cf288f3b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Flow 'volume_create_manager' (9f01f875-76ca-4ce8-83e1-5c17c25a7a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-17b6b4f2-3327-416b-a085-30c9ca711147 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Created volume successfully. Apr 15 10:18:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Creating offline snapshot e15f51f0-088c-4d82-9368-4b94b482062d of volume 9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:18:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a30f0-1b3b-4e2b-b3b9-4f8c10cfa33c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:06 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 Apr 15 10:18:06 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:06 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d 2G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:06 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d 2G Apr 15 10:18:06 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:07 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d 2G" returned: 0 in 0.471s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:07 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d Apr 15 10:18:07 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:07 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d" returned: 0 in 0.421s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:07 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d is being set with open permissions: ugo+rw Apr 15 10:18:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:07 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d Apr 15 10:18:07 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:08 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d" returned: 0 in 0.402s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:08 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.info Apr 15 10:18:08 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:08 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.info" returned: 0 in 0.414s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:08 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.info is being set with open permissions: ugo+rw Apr 15 10:18:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:08 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.info Apr 15 10:18:08 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:08 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.info" returned: 0 in 0.413s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5481713e-557e-40fe-ad18-f0d252b15ed9 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Create snapshot completed successfully Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "cinder-e15f51f0-088c-4d82-9368-4b94b482062d-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-e15f51f0-088c-4d82-9368-4b94b482062d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "cinder-quobyte-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-quobyte-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "cinder-quobyte-e15f51f0-088c-4d82-9368-4b94b482062d" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-quobyte-e15f51f0-088c-4d82-9368-4b94b482062d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Deleting offline snapshot e15f51f0-088c-4d82-9368-4b94b482062d of volume 9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] snapshot_file for this snap is: volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3341c1-c038-4d46-a509-442415d403c7]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:09 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d Apr 15 10:18:09 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:09 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff197956-bbf9-4733-a640-9b44c5ad5ed8]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:10 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 Apr 15 10:18:10 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:10 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" returned: 0 in 0.471s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:10 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d Apr 15 10:18:10 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:10 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d" returned: 0 in 0.443s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:10 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d Apr 15 10:18:10 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:11 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6.e15f51f0-088c-4d82-9368-4b94b482062d" returned: 0 in 0.411s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-quobyte-e15f51f0-088c-4d82-9368-4b94b482062d" released by "_delete_snapshot" :: held 1.857s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-quobyte-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" released by "delete_snapshot" :: held 1.873s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Created reservations ['5f271ab4-28ef-4a8d-ab7d-2790676f9aa7', '1fad19eb-d26f-459e-adeb-36683d8e06e5', '7267cc4d-efc2-4e43-94e0-aee1ed8cad12', 'c0e06c57-5be4-47b8-a05f-73a67d540273'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Delete snapshot completed successfully. Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5ab8e215-285c-4a07-9731-8538e1e53937 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-e15f51f0-088c-4d82-9368-4b94b482062d-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "cinder-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "cinder-quobyte-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-quobyte-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6186b08f-e54d-41ae-9f1f-17d828a2c530]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:11 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 Apr 15 10:18:11 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:12 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" returned: 0 in 0.473s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:12 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6 Apr 15 10:18:12 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:12 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" returned: 0 in 0.419s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-quobyte-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6" released by "delete_volume" :: held 0.919s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Created reservations ['9e4d4756-d303-46b1-a142-37fb97ac4d6c', 'f31e148e-3344-4274-8c0b-77a6df5f7cb4', 'b16d74ad-d573-445e-830e-2a64c0b48d53', '6f4320c6-aa20-488b-a3e2-aee7163bb219'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:12 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:12 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:13 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Deleted volume successfully. Apr 15 10:18:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-422e3912-cb0f-4de1-9921-d738b85fa584 tempest-VolumesSnapshotNegativeTestJSON-1209497043 None] Lock "cinder-9d46c9fa-cf50-402c-9cf1-f0097f14cfa6-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (c56c3afc-5c55-4477-8713-1221912def4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986eb06a-ecc5-4bce-aadc-5ebdd62e1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986eb06a-ecc5-4bce-aadc-5ebdd62e1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392694226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e54158-a3fe-419b-ba48-22f7845ce6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:14Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782484bd-5355-449c-b44b-9b7e880eae37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782484bd-5355-449c-b44b-9b7e880eae37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f8bbe-2759-4032-95f0-4788d5045f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f8bbe-2759-4032-95f0-4788d5045f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e54158-a3fe-419b-ba48-22f7845ce6f9', 'volume_name': 'volume-55e54158-a3fe-419b-ba48-22f7845ce6f9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbac985-4a0c-4582-b257-d98714089fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbac985-4a0c-4582-b257-d98714089fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c653e129-29b7-4b79-98ee-108ea21b2f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Volume 55e54158-a3fe-419b-ba48-22f7845ce6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e54158-a3fe-419b-ba48-22f7845ce6f9', 'volume_size': 1} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392694226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e54158-a3fe-419b-ba48-22f7845ce6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:14Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Creating volume 55e54158-a3fe-419b-ba48-22f7845ce6f9 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:14 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 1073741824 Apr 15 10:18:14 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (0bbe4036-d40a-4d9f-8c0e-afa359b37ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52e738e-62f0-4249-bbb3-4b3655f17d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52e738e-62f0-4249-bbb3-4b3655f17d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296106785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:14Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfdcf73-f842-49b8-8f4f-6a025cdd2f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfdcf73-f842-49b8-8f4f-6a025cdd2f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11f5ae4-2f75-4c1e-8578-6dac1ea4d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11f5ae4-2f75-4c1e-8578-6dac1ea4d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b', 'volume_name': 'volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c671ae-fcb6-47e0-8086-07270a091cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c671ae-fcb6-47e0-8086-07270a091cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ea0293-9024-4376-b29e-6e5020b53905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Volume b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b', 'volume_size': 1} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (74f1a4ba-cb6e-4890-b448-8ba98bea8792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe2b42b-c168-4e4f-a58f-1a9fe8aebe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe2b42b-c168-4e4f-a58f-1a9fe8aebe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1180877204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289c5554-36bf-4696-9aa0-fd48c04882b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:15Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be409788-dfd9-4fed-9033-c35669e6c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be409788-dfd9-4fed-9033-c35669e6c884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d16bc6a-a3d6-45a3-86c6-5b346d7f0468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d16bc6a-a3d6-45a3-86c6-5b346d7f0468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '289c5554-36bf-4696-9aa0-fd48c04882b5', 'volume_name': 'volume-289c5554-36bf-4696-9aa0-fd48c04882b5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8081426a-e4da-4773-8b5b-c4572849118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8081426a-e4da-4773-8b5b-c4572849118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8911e927-c39b-409d-bbf5-004cbe5fb255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Volume 289c5554-36bf-4696-9aa0-fd48c04882b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-289c5554-36bf-4696-9aa0-fd48c04882b5', 'volume_size': 1} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (fc2f10e6-dcec-4a9d-af0d-853147b593f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e08412c-07d1-4a53-85db-fb7dce79a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e08412c-07d1-4a53-85db-fb7dce79a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868940479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df90cf4b-0d10-49b0-8b83-4b9f4a93d71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:15Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578fa65c-5785-4982-9a7a-26e638dd9bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578fa65c-5785-4982-9a7a-26e638dd9bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291baebf-454b-4ac8-b027-d9154bf96425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291baebf-454b-4ac8-b027-d9154bf96425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df90cf4b-0d10-49b0-8b83-4b9f4a93d71e', 'volume_name': 'volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d701813-ea19-4b62-b077-54acb09f07f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d701813-ea19-4b62-b077-54acb09f07f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bf56b5-f385-4ae9-9928-d6da2a1862d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:14 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Volume df90cf4b-0d10-49b0-8b83-4b9f4a93d71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e', 'volume_size': 1} Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:14 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 1073741824" returned: 0 in 0.623s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:15 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 Apr 15 10:18:15 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (43ff31b9-ef6f-4bf9-b47c-ca0de4349095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f526b4bb-c327-4690-9842-2db113412f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f526b4bb-c327-4690-9842-2db113412f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026341511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea18ae1-f513-4cca-ab1b-86a2f2b419f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:15Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72412a83-ef75-4e4b-a1f8-0841878ab9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72412a83-ef75-4e4b-a1f8-0841878ab9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19e94a4-53ba-4675-be57-f5b118302fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19e94a4-53ba-4675-be57-f5b118302fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea18ae1-f513-4cca-ab1b-86a2f2b419f2', 'volume_name': 'volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060b2ee0-4cf1-4ee6-a086-021281a1ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060b2ee0-4cf1-4ee6-a086-021281a1ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103008f5-9b26-4a6b-a587-b2ddd7891e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Volume 8ea18ae1-f513-4cca-ab1b-86a2f2b419f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2', 'volume_size': 1} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:15 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9" returned: 0 in 0.455s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1296106785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:14Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Creating volume b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:15 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c653e129-29b7-4b79-98ee-108ea21b2f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e54158-a3fe-419b-ba48-22f7845ce6f9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73277c9b-67a1-49ed-a54b-59574146804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:15 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b 1073741824 Apr 15 10:18:15 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Volume volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 (55e54158-a3fe-419b-ba48-22f7845ce6f9): created successfully Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73277c9b-67a1-49ed-a54b-59574146804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (c56c3afc-5c55-4477-8713-1221912def4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a77d2030-3d0d-4b75-90b2-514610d75c53 tempest-CreateVolumesFromImageTest-1974967410 None] Created volume successfully. Apr 15 10:18:15 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b 1073741824" returned: 0 in 0.506s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:16 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b Apr 15 10:18:16 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:16 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b" returned: 0 in 0.423s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1180877204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289c5554-36bf-4696-9aa0-fd48c04882b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:15Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Creating volume 289c5554-36bf-4696-9aa0-fd48c04882b5 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:16 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ea0293-9024-4376-b29e-6e5020b53905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea495de-32e1-4d70-9c10-dcdc3f45fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:16 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 1073741824 Apr 15 10:18:16 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Volume volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b (b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b): created successfully Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dea495de-32e1-4d70-9c10-dcdc3f45fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (0bbe4036-d40a-4d9f-8c0e-afa359b37ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-62d5c87a-20e9-41ca-aa9c-4b136cf3492f tempest-CreateVolumesFromImageTest-1974967410 None] Created volume successfully. Apr 15 10:18:16 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 1073741824" returned: 0 in 0.558s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:17 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 Apr 15 10:18:17 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:17 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5" returned: 0 in 0.491s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.554s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1868940479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df90cf4b-0d10-49b0-8b83-4b9f4a93d71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:15Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Creating volume df90cf4b-0d10-49b0-8b83-4b9f4a93d71e {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:17 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8911e927-c39b-409d-bbf5-004cbe5fb255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-289c5554-36bf-4696-9aa0-fd48c04882b5', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:17 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e 1073741824 Apr 15 10:18:17 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f24c4bd-e923-410e-97a4-212f89650dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Volume volume-289c5554-36bf-4696-9aa0-fd48c04882b5 (289c5554-36bf-4696-9aa0-fd48c04882b5): created successfully Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f24c4bd-e923-410e-97a4-212f89650dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (74f1a4ba-cb6e-4890-b448-8ba98bea8792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e37d4cfa-8e59-4f71-89ed-4245954dc6e3 tempest-CreateVolumesFromImageTest-1974967410 None] Created volume successfully. Apr 15 10:18:18 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e 1073741824" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:18 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e Apr 15 10:18:18 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:18 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e" returned: 0 in 0.414s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.272s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026341511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea18ae1-f513-4cca-ab1b-86a2f2b419f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31db04d67dfe41d78f3a21be365bad35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:15Z,use_quota=True,user_id='7fdd49828e8a49d393964bd5037f62d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Creating volume 8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:18 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bf56b5-f385-4ae9-9928-d6da2a1862d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb2aa5b-9c05-4c53-b381-351f0016fd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:18 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 1073741824 Apr 15 10:18:18 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:18 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Volume volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e (df90cf4b-0d10-49b0-8b83-4b9f4a93d71e): created successfully Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb2aa5b-9c05-4c53-b381-351f0016fd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (fc2f10e6-dcec-4a9d-af0d-853147b593f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:18 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-14ebd4c4-96ed-4083-befc-b11cd1960a8b tempest-CreateVolumesFromImageTest-1974967410 None] Created volume successfully. Apr 15 10:18:18 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 1073741824" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:18 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 Apr 15 10:18:18 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:19 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2" returned: 0 in 0.393s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103008f5-9b26-4a6b-a587-b2ddd7891e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430a0cea-0d2b-4890-af38-170332eb4557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:19 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Volume volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 (8ea18ae1-f513-4cca-ab1b-86a2f2b419f2): created successfully Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430a0cea-0d2b-4890-af38-170332eb4557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Flow 'volume_create_manager' (43ff31b9-ef6f-4bf9-b47c-ca0de4349095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:19 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-aeb5f6a4-b720-42b5-9622-1bc1d3acab1b tempest-CreateVolumesFromImageTest-1974967410 None] Created volume successfully. Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-quobyte-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b6492f-3144-4aee-867f-9769156e2310]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:19 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 Apr 15 10:18:19 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:20 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2" returned: 0 in 0.476s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:20 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2 Apr 15 10:18:20 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:20 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2" returned: 0 in 0.409s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2" released by "delete_volume" :: held 0.911s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Created reservations ['5dee8d61-1c7d-4f72-96f8-aff9b7d7d24e', 'ea592cc8-d312-4868-b654-5768100bd61b', '8fd33a31-d01b-401f-94a3-bda9082982a2', '0b87e50e-bc4b-4072-bac6-12ad319ed3c0'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:20 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:20 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-quobyte-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8195697-7018-4276-9d80-5dc5a764cfbd]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:20 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e Apr 15 10:18:20 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:21 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Deleted volume successfully. Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c7456923-6c97-4568-8604-bf57f3326400 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-8ea18ae1-f513-4cca-ab1b-86a2f2b419f2-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:21 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e" returned: 0 in 0.500s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:21 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e Apr 15 10:18:21 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:21 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e" returned: 0 in 0.433s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e" released by "delete_volume" :: held 0.963s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Created reservations ['70056079-ab87-40e2-9d5a-66369ce68165', '248e7f33-bdd9-43fe-84db-2eaed2d04524', 'e00db762-9b5d-4bad-9ca8-c67415b8cf14', 'ace3ca2e-0ae4-4224-b912-f1f95444c09d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:21 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:21 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-289c5554-36bf-4696-9aa0-fd48c04882b5-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-289c5554-36bf-4696-9aa0-fd48c04882b5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-quobyte-289c5554-36bf-4696-9aa0-fd48c04882b5" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-289c5554-36bf-4696-9aa0-fd48c04882b5" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cf1d0-e53f-4421-905e-b05fc48198c8]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:21 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 Apr 15 10:18:21 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:22 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.451s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Deleted volume successfully. Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5e52d0c6-4daf-4c39-ba23-60dd7d316f08 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-df90cf4b-0d10-49b0-8b83-4b9f4a93d71e-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:22 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:22 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5 Apr 15 10:18:22 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:22 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-289c5554-36bf-4696-9aa0-fd48c04882b5" returned: 0 in 0.401s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-289c5554-36bf-4696-9aa0-fd48c04882b5" released by "delete_volume" :: held 0.899s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Created reservations ['ef783a4f-e855-4e17-b507-5901aaf90892', '0bc00c81-8fb8-4a2b-b32b-707a5133b986', 'f123bf1f-0f1b-4a5f-9c91-072efb0b302b', '210c99d3-b302-47d5-bec9-34b37b328945'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:22 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:22 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-quobyte-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4482cd-0924-453a-8e26-fcd3eaca90d7]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:23 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b Apr 15 10:18:23 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:23 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.428s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Deleted volume successfully. Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1afbc552-1108-493b-b7c1-8a5a0ec37f4e tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-289c5554-36bf-4696-9aa0-fd48c04882b5-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:23 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b" returned: 0 in 0.482s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:23 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b Apr 15 10:18:23 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:23 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b" returned: 0 in 0.393s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b" released by "delete_volume" :: held 0.901s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Created reservations ['8813b3e6-1d0a-4251-964a-953866dbfa62', '91a3e086-8793-4c0c-b7e6-b6c2484a7472', '8526384e-5020-4660-b3e4-acdba219aebc', '94f86859-2f0c-43f5-b15d-2220c77c898d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:23 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:23 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-55e54158-a3fe-419b-ba48-22f7845ce6f9-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-55e54158-a3fe-419b-ba48-22f7845ce6f9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "cinder-quobyte-55e54158-a3fe-419b-ba48-22f7845ce6f9" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-55e54158-a3fe-419b-ba48-22f7845ce6f9" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b16faf-a263-452e-b845-ca76bb7c4be1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:24 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 Apr 15 10:18:24 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:24 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.463s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Deleted volume successfully. Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-c561ef9a-6dbc-4a82-8eec-38a2cd5bbcb1 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-b6ed27ca-49ff-45f6-8a84-22a9f1c2bf6b-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:24 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:24 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9 Apr 15 10:18:24 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:24 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-55e54158-a3fe-419b-ba48-22f7845ce6f9" returned: 0 in 0.396s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-quobyte-55e54158-a3fe-419b-ba48-22f7845ce6f9" released by "delete_volume" :: held 0.880s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:24 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Created reservations ['5830cd8d-968f-49d1-ae99-592a4a6631bb', '75fdbb67-019c-42e1-a845-b9f9ed5b44cd', 'bc8756ed-d270-4125-90f6-df2fad696f6c', '1ca0942b-ba3c-4e03-a34e-4ab3ee00f1f6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:25 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:25 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:25 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.433s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Deleted volume successfully. Apr 15 10:18:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-048b3275-6e2c-46a5-90a7-22e71d7568d7 tempest-CreateVolumesFromImageTest-1974967410 None] Lock "cinder-55e54158-a3fe-419b-ba48-22f7845ce6f9-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Flow 'volume_create_manager' (feb10f45-f1e8-4ed0-a260-7a0c8cb08f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e48c043-8075-42b4-b3bd-b75edecc2b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e48c043-8075-42b4-b3bd-b75edecc2b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9828e9b4-029f-4a0f-8b64-bbc35e3a2815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58b40c7a2544d27a38ea2d8a80c5c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:27Z,use_quota=True,user_id='fd42043355a24940937a0a709eedc030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddefb483-8b4f-4195-83a8-83dbb8ec4e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddefb483-8b4f-4195-83a8-83dbb8ec4e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69419e5-78a1-4796-ae3a-073ec1cf5f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69419e5-78a1-4796-ae3a-073ec1cf5f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9828e9b4-029f-4a0f-8b64-bbc35e3a2815', 'volume_name': 'volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da7d158-fa60-4173-a9d1-0a6045f9fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da7d158-fa60-4173-a9d1-0a6045f9fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e899b5-9b5f-4b0b-9f56-b6fd3f7bc8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:26 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Volume 9828e9b4-029f-4a0f-8b64-bbc35e3a2815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815', 'volume_size': 1} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9828e9b4-029f-4a0f-8b64-bbc35e3a2815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58b40c7a2544d27a38ea2d8a80c5c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:27Z,use_quota=True,user_id='fd42043355a24940937a0a709eedc030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Creating volume 9828e9b4-029f-4a0f-8b64-bbc35e3a2815 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:26 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:26 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 1073741824 Apr 15 10:18:26 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:27 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 1073741824" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:27 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 Apr 15 10:18:27 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:27 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815" returned: 0 in 0.419s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e899b5-9b5f-4b0b-9f56-b6fd3f7bc8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fd936f-67e4-4b7b-8390-eb53a14808b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:27 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Volume volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 (9828e9b4-029f-4a0f-8b64-bbc35e3a2815): created successfully Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fd936f-67e4-4b7b-8390-eb53a14808b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:27 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Flow 'volume_create_manager' (feb10f45-f1e8-4ed0-a260-7a0c8cb08f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:27 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-242587d4-cac4-4bf7-8c48-335866c435ed tempest-CinderUnicodeTest-982190863 None] Created volume successfully. Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Flow 'volume_create_manager' (ea3ee738-1181-4a03-8257-eb5def2e865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6176265-c511-4cdd-b5f6-931d8539ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6176265-c511-4cdd-b5f6-931d8539ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-733959726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc24afe-cbfb-4090-859f-4e9e3ca53ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58b40c7a2544d27a38ea2d8a80c5c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:29Z,use_quota=True,user_id='fd42043355a24940937a0a709eedc030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4984437-9b0b-4c4f-b556-be31093c6389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4984437-9b0b-4c4f-b556-be31093c6389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93603d77-b7d1-49f6-bdaa-a44b558456f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93603d77-b7d1-49f6-bdaa-a44b558456f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc24afe-cbfb-4090-859f-4e9e3ca53ce0', 'volume_name': 'volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f236a7c-8295-4e02-a565-1df359818c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f236a7c-8295-4e02-a565-1df359818c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0639cfe1-4d3a-4838-8881-b9c93498386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:29 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Volume dfc24afe-cbfb-4090-859f-4e9e3ca53ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0', 'volume_size': 1} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-733959726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc24afe-cbfb-4090-859f-4e9e3ca53ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e58b40c7a2544d27a38ea2d8a80c5c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:29Z,use_quota=True,user_id='fd42043355a24940937a0a709eedc030',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Creating volume dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:29 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:29 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 1073741824 Apr 15 10:18:29 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:29 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 1073741824" returned: 0 in 0.478s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:29 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 Apr 15 10:18:29 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:30 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" returned: 0 in 0.402s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0639cfe1-4d3a-4838-8881-b9c93498386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c8819a-d1b2-401b-ac33-95e6397a82b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:30 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Volume volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 (dfc24afe-cbfb-4090-859f-4e9e3ca53ce0): created successfully Apr 15 10:18:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c8819a-d1b2-401b-ac33-95e6397a82b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:30 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Flow 'volume_create_manager' (ea3ee738-1181-4a03-8257-eb5def2e865a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-66696f9b-4817-4ae8-9a5d-5b16062ef48c tempest-CinderUnicodeTest-982190863 None] Created volume successfully. Apr 15 10:18:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:31 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Creating offline snapshot 8f797e6e-cff7-4f66-92ae-50a985218940 of volume dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:18:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b23a91-70e7-4f80-bedc-54df4c4d0285]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:31 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 Apr 15 10:18:31 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:31 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" returned: 0 in 0.455s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:31 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 1G Apr 15 10:18:31 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:32 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 1G" returned: 0 in 0.461s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:32 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 Apr 15 10:18:32 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:32 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940" returned: 0 in 0.415s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:32 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 is being set with open permissions: ugo+rw Apr 15 10:18:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:32 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 Apr 15 10:18:32 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:33 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940" returned: 0 in 0.388s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:33 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.info Apr 15 10:18:33 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:33 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:33 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:33 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.info" returned: 0 in 0.421s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:33 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.info is being set with open permissions: ugo+rw Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:33 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.info Apr 15 10:18:33 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:33 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.428s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:34 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.info" returned: 0 in 0.435s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:34 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-adadb48c-6b7f-4d63-b675-723935548c60 tempest-CinderUnicodeTest-982190863 None] Create snapshot completed successfully Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "cinder-8f797e6e-cff7-4f66-92ae-50a985218940-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-8f797e6e-cff7-4f66-92ae-50a985218940-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "cinder-quobyte-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "cinder-quobyte-8f797e6e-cff7-4f66-92ae-50a985218940" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-8f797e6e-cff7-4f66-92ae-50a985218940" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Deleting offline snapshot 8f797e6e-cff7-4f66-92ae-50a985218940 of volume dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] snapshot_file for this snap is: volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a738c-3654-43dc-a0b5-9782ad95e77f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:34 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 Apr 15 10:18:34 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:35 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940" returned: 0 in 0.469s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d8eb38-a654-4dc2-8eb3-a021877c82d9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:35 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 Apr 15 10:18:35 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:35 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" returned: 0 in 0.465s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:35 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 Apr 15 10:18:35 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:35 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940" returned: 0 in 0.445s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:35 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940 Apr 15 10:18:35 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:36 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0.8f797e6e-cff7-4f66-92ae-50a985218940" returned: 0 in 0.401s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-8f797e6e-cff7-4f66-92ae-50a985218940" released by "_delete_snapshot" :: held 1.836s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" released by "delete_snapshot" :: held 1.848s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Created reservations ['9838bbe6-0554-4ec6-8ef8-b9214c8f2d5f', '660bfdfb-8afe-4d2e-ae31-fafe7f9dc74f', 'f9912eaa-14fb-49a1-aee8-177d4a0de4ef', 'f06aa4de-52e5-4982-9481-fde0b75800c8'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Delete snapshot completed successfully. Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d36dac47-6d48-4998-8afe-679f2fe23a01 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-8f797e6e-cff7-4f66-92ae-50a985218940-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "cinder-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "cinder-quobyte-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[251a6948-03f5-44fa-b38d-94b07897c014]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:36 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 Apr 15 10:18:36 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:37 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:37 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0 Apr 15 10:18:37 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:37 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" returned: 0 in 0.417s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0" released by "delete_volume" :: held 0.940s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Created reservations ['1822a22b-dcee-4772-be3f-f503eb5410c5', '6f63cabf-7374-4533-b7f4-759d12dd2eb7', 'd177422b-d2ae-4c16-8dfc-9b3ae030f659', '7cb7916c-7465-49f4-8beb-e06ba29c8cb4'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:37 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:37 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "cinder-9828e9b4-029f-4a0f-8b64-bbc35e3a2815-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-9828e9b4-029f-4a0f-8b64-bbc35e3a2815-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "cinder-quobyte-9828e9b4-029f-4a0f-8b64-bbc35e3a2815" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-9828e9b4-029f-4a0f-8b64-bbc35e3a2815" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9601dd2-2421-4383-b12b-81fe5ecff8bc]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:37 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 Apr 15 10:18:37 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:38 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.429s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Deleted volume successfully. Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-6684a93e-2227-4cf9-a47f-79d5aa77ebb5 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-dfc24afe-cbfb-4090-859f-4e9e3ca53ce0-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:38 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815" returned: 0 in 0.480s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:38 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815 Apr 15 10:18:38 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:38 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-9828e9b4-029f-4a0f-8b64-bbc35e3a2815" returned: 0 in 0.409s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-quobyte-9828e9b4-029f-4a0f-8b64-bbc35e3a2815" released by "delete_volume" :: held 0.910s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Created reservations ['668f2607-4d03-496f-ae90-2835c4154894', '77fed2a8-22d4-4c16-b254-de33b3508007', '680b77e0-f187-45a5-a94e-5101c75d2e8c', 'afe59a79-d489-4ffd-bdee-962d85b4f2c6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:38 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:38 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:39 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.448s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:39 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Deleted volume successfully. Apr 15 10:18:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-591f819e-6d48-4ad1-8cf3-72a064ac49d3 tempest-CinderUnicodeTest-982190863 None] Lock "cinder-9828e9b4-029f-4a0f-8b64-bbc35e3a2815-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (e42f725e-1b1b-47f3-9688-60e104d8a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1212cd56-a27a-4bc1-96e8-66ca7e7f968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1212cd56-a27a-4bc1-96e8-66ca7e7f968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1999124493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e373d29-dd79-45ab-8422-e79d7ce57a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4703530eb84fe5bdb5ddcfa071a28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='c8f990ac40d84800a86ade15d8f41586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdfa25b-8ae4-41aa-929c-21329c54b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdfa25b-8ae4-41aa-929c-21329c54b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1d0670-553e-4307-953a-b91a663d8980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1d0670-553e-4307-953a-b91a663d8980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e373d29-dd79-45ab-8422-e79d7ce57a70', 'volume_name': 'volume-5e373d29-dd79-45ab-8422-e79d7ce57a70', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86938653-2839-4706-9d7b-7c2c90a61b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86938653-2839-4706-9d7b-7c2c90a61b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b34bd89-8998-4c84-8b1c-2f18718a4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:45 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Volume 5e373d29-dd79-45ab-8422-e79d7ce57a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e373d29-dd79-45ab-8422-e79d7ce57a70', 'volume_size': 1} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1999124493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e373d29-dd79-45ab-8422-e79d7ce57a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4703530eb84fe5bdb5ddcfa071a28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='c8f990ac40d84800a86ade15d8f41586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Creating volume 5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:45 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:45 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 1073741824 Apr 15 10:18:45 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (c9c7fdce-a186-4639-af66-aaafcbe08703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba17fc-a402-448f-9dfe-264df37e995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba17fc-a402-448f-9dfe-264df37e995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138967726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91708f3-201d-44d8-b9d5-1d81ec24a374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5f741-a4a6-4520-9bf9-18ca4038c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5f741-a4a6-4520-9bf9-18ca4038c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424cf83c-3b37-4349-b052-d90115e6753a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424cf83c-3b37-4349-b052-d90115e6753a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91708f3-201d-44d8-b9d5-1d81ec24a374', 'volume_name': 'volume-a91708f3-201d-44d8-b9d5-1d81ec24a374', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5986e8e2-5a82-4102-8906-3423546c3d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5986e8e2-5a82-4102-8906-3423546c3d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6f9f28-411b-438f-af13-557d6610452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Volume a91708f3-201d-44d8-b9d5-1d81ec24a374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91708f3-201d-44d8-b9d5-1d81ec24a374', 'volume_size': 1} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (d61b8bee-9a64-4fbf-8f4c-ef9ad2b6949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8faeb8e3-372d-4d5e-a9ab-1a749b5d7621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8faeb8e3-372d-4d5e-a9ab-1a749b5d7621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680607130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7d2324-636d-4e0f-b961-5e0a4f1ad17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b20149e-f7d7-46b0-857d-9b759956d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b20149e-f7d7-46b0-857d-9b759956d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239bcea6-6d79-48d6-b002-69ffb0e0893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239bcea6-6d79-48d6-b002-69ffb0e0893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7d2324-636d-4e0f-b961-5e0a4f1ad17a', 'volume_name': 'volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d099ec68-e21e-4ac8-acb1-461a513c07b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d099ec68-e21e-4ac8-acb1-461a513c07b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc1233-838a-42b0-841b-2595e8a03931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume 7a7d2324-636d-4e0f-b961-5e0a4f1ad17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a', 'volume_size': 1} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (0a9bec2e-629c-49b0-8c26-cd97983e8cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d44f6f-9690-409a-bd99-a0c5a1351d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d44f6f-9690-409a-bd99-a0c5a1351d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-630822174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873b2d91-10a7-4786-8c02-9994d08d4362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c98620-e9c7-474f-999c-2887f4feb346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c98620-e9c7-474f-999c-2887f4feb346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe54f1f-6338-448e-973d-eeea6dd41210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe54f1f-6338-448e-973d-eeea6dd41210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873b2d91-10a7-4786-8c02-9994d08d4362', 'volume_name': 'volume-873b2d91-10a7-4786-8c02-9994d08d4362', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfbf147-8279-4759-9568-c8ede57ef4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfbf147-8279-4759-9568-c8ede57ef4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a06ee4-ccc9-4be4-8bc7-797942b732bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Volume 873b2d91-10a7-4786-8c02-9994d08d4362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873b2d91-10a7-4786-8c02-9994d08d4362', 'volume_size': 1} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (3c579264-6f69-4c34-9e7e-294fae077c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c05d408-f8ee-4e57-9e6f-f7dfa6e2ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c05d408-f8ee-4e57-9e6f-f7dfa6e2ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138156685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4236ba9-e8c0-4560-b257-3a37236bd58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:47Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a47b8a4-a20a-4338-9f67-518445f6e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a47b8a4-a20a-4338-9f67-518445f6e927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3974fe-54bc-49af-a41b-dbc9a8ccee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3974fe-54bc-49af-a41b-dbc9a8ccee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4236ba9-e8c0-4560-b257-3a37236bd58e', 'volume_name': 'volume-b4236ba9-e8c0-4560-b257-3a37236bd58e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d16527-c8ba-48f5-b38c-fd662d0c5d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d16527-c8ba-48f5-b38c-fd662d0c5d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aa83b5-a488-4b98-9f78-7f9dea887c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Volume b4236ba9-e8c0-4560-b257-3a37236bd58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4236ba9-e8c0-4560-b257-3a37236bd58e', 'volume_size': 1} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:46 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (03dc08dd-ffd1-44b3-9d63-9e1fcbe6872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea720f5d-0ca3-4080-9fe4-1457e29dbec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 1073741824" returned: 0 in 0.933s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea720f5d-0ca3-4080-9fe4-1457e29dbec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575909602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f6c379-8cea-4205-88ac-10cd27720803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:47Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf956db0-6d20-4f15-9c0f-f67b81939d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf956db0-6d20-4f15-9c0f-f67b81939d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4b8f0f-5f98-406b-b0be-2bde5d4d2933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4b8f0f-5f98-406b-b0be-2bde5d4d2933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f6c379-8cea-4205-88ac-10cd27720803', 'volume_name': 'volume-f1f6c379-8cea-4205-88ac-10cd27720803', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ad5050-52fd-47d9-904e-6553abb3de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ad5050-52fd-47d9-904e-6553abb3de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e9bc6-173f-4a47-b261-1872be77a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:46 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Volume f1f6c379-8cea-4205-88ac-10cd27720803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f6c379-8cea-4205-88ac-10cd27720803', 'volume_size': 1} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:46 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 Apr 15 10:18:46 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (5e491c9b-38da-483f-99f4-29c8ed5c0f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261de2b4-b10f-44f1-b266-a9289cb9d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261de2b4-b10f-44f1-b266-a9289cb9d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-702645495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac69fa2d-f00d-4033-84d1-5d195f19a22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:47Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f33bd6-9593-4de4-b2e2-e4535a58c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f33bd6-9593-4de4-b2e2-e4535a58c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46579fd7-315b-4743-95a7-082f0060f28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46579fd7-315b-4743-95a7-082f0060f28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac69fa2d-f00d-4033-84d1-5d195f19a22f', 'volume_name': 'volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e7ae2d-d97b-47a1-a43c-7406592b6b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e7ae2d-d97b-47a1-a43c-7406592b6b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26db6501-a7b6-44c1-9fe9-adde0a3ba9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:47 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Volume ac69fa2d-f00d-4033-84d1-5d195f19a22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f', 'volume_size': 1} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:47 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70" returned: 0 in 0.500s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.119s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138967726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91708f3-201d-44d8-b9d5-1d81ec24a374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Creating volume a91708f3-201d-44d8-b9d5-1d81ec24a374 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:47 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b34bd89-8998-4c84-8b1c-2f18718a4529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e373d29-dd79-45ab-8422-e79d7ce57a70', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27348e81-6c74-4a05-85ab-45cf2af4b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:47 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 1073741824 Apr 15 10:18:47 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:47 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Volume volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 (5e373d29-dd79-45ab-8422-e79d7ce57a70): created successfully Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27348e81-6c74-4a05-85ab-45cf2af4b12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (e42f725e-1b1b-47f3-9688-60e104d8a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c0ed0234-295c-43ea-88ec-da9348c4bcd0 tempest-VolumeDependencyTests-1512334694 None] Created volume successfully. Apr 15 10:18:47 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 1073741824" returned: 0 in 0.522s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:47 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 Apr 15 10:18:47 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:48 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374" returned: 0 in 0.507s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-680607130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7d2324-636d-4e0f-b961-5e0a4f1ad17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Creating volume 7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:48 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6f9f28-411b-438f-af13-557d6610452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91708f3-201d-44d8-b9d5-1d81ec24a374', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac08640-5022-444c-b039-80f84b9afd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:48 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a 1073741824 Apr 15 10:18:48 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:48 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Volume volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 (a91708f3-201d-44d8-b9d5-1d81ec24a374): created successfully Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac08640-5022-444c-b039-80f84b9afd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:48 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (c9c7fdce-a186-4639-af66-aaafcbe08703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:48 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1c9c6583-2313-4b81-9d63-cf17500e2138 tempest-CreateVolumesFromImageTest-1947604468 None] Created volume successfully. Apr 15 10:18:49 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a 1073741824" returned: 0 in 0.568s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:49 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a Apr 15 10:18:49 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:49 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" returned: 0 in 0.454s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.972s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-630822174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873b2d91-10a7-4786-8c02-9994d08d4362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:46Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Creating volume 873b2d91-10a7-4786-8c02-9994d08d4362 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:49 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dc1233-838a-42b0-841b-2595e8a03931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d66d680-535b-4518-8d44-0023f5a0a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:49 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 1073741824 Apr 15 10:18:49 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:49 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a (7a7d2324-636d-4e0f-b961-5e0a4f1ad17a): created successfully Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d66d680-535b-4518-8d44-0023f5a0a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:49 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (d61b8bee-9a64-4fbf-8f4c-ef9ad2b6949a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:49 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1318cb57-63c2-4f57-b949-687008e15127 tempest-CreateVolumesFromSnapshotTest-213222752 None] Created volume successfully. Apr 15 10:18:50 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 1073741824" returned: 0 in 0.535s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:50 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 Apr 15 10:18:50 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:50 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362" returned: 0 in 0.512s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.822s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138156685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4236ba9-e8c0-4560-b257-3a37236bd58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:47Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Creating volume b4236ba9-e8c0-4560-b257-3a37236bd58e {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:50 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a06ee4-ccc9-4be4-8bc7-797942b732bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873b2d91-10a7-4786-8c02-9994d08d4362', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:50 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e 1073741824 Apr 15 10:18:50 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49ab80c-0761-4b3e-a0a1-c294d9c2c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:50 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Volume volume-873b2d91-10a7-4786-8c02-9994d08d4362 (873b2d91-10a7-4786-8c02-9994d08d4362): created successfully Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49ab80c-0761-4b3e-a0a1-c294d9c2c7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:50 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (0a9bec2e-629c-49b0-8c26-cd97983e8cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8c21968c-1484-47b7-a6a4-f4db780d43e1 tempest-CreateVolumesFromImageTest-1947604468 None] Created volume successfully. Apr 15 10:18:51 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e 1073741824" returned: 0 in 0.541s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:51 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e Apr 15 10:18:51 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:51 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.784s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575909602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f6c379-8cea-4205-88ac-10cd27720803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:47Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Creating volume f1f6c379-8cea-4205-88ac-10cd27720803 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:51 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aa83b5-a488-4b98-9f78-7f9dea887c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4236ba9-e8c0-4560-b257-3a37236bd58e', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:51 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 1073741824 Apr 15 10:18:51 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b148a60d-1b20-4543-9109-8063ad3e0cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:51 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Volume volume-b4236ba9-e8c0-4560-b257-3a37236bd58e (b4236ba9-e8c0-4560-b257-3a37236bd58e): created successfully Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b148a60d-1b20-4543-9109-8063ad3e0cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:51 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (3c579264-6f69-4c34-9e7e-294fae077c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-e293e1d8-88bb-4895-acec-84aa372147ee tempest-CreateVolumesFromImageTest-1947604468 None] Created volume successfully. Apr 15 10:18:52 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 1073741824" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:52 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 Apr 15 10:18:52 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:52 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803" returned: 0 in 0.436s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.496s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-702645495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac69fa2d-f00d-4033-84d1-5d195f19a22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ca59ad07c44d0fbe695935669bd447',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:47Z,use_quota=True,user_id='2f81d85d8d82486dbc0f86462d0865b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Creating volume ac69fa2d-f00d-4033-84d1-5d195f19a22f {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:18:52 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e9bc6-173f-4a47-b261-1872be77a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f6c379-8cea-4205-88ac-10cd27720803', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:52 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f 1073741824 Apr 15 10:18:52 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21a0e0-ce9e-4670-ac07-99ec313650dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:52 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Volume volume-f1f6c379-8cea-4205-88ac-10cd27720803 (f1f6c379-8cea-4205-88ac-10cd27720803): created successfully Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21a0e0-ce9e-4670-ac07-99ec313650dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:52 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (03dc08dd-ffd1-44b3-9d63-9e1fcbe6872c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:52 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5b61bc12-ee8a-4bff-bcef-306dd2eb758c tempest-CreateVolumesFromImageTest-1947604468 None] Created volume successfully. Apr 15 10:18:53 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f 1073741824" returned: 0 in 0.557s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:53 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f Apr 15 10:18:53 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:53 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f" returned: 0 in 0.482s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.408s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26db6501-a7b6-44c1-9fe9-adde0a3ba9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d8b8a9-ab85-4cb8-8a84-90a5ecc4f396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Creating offline snapshot b29daa25-17a5-42d7-b8ef-5f957d41b987 of volume 5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:18:53 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Volume volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f (ac69fa2d-f00d-4033-84d1-5d195f19a22f): created successfully Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d8b8a9-ab85-4cb8-8a84-90a5ecc4f396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Flow 'volume_create_manager' (5e491c9b-38da-483f-99f4-29c8ed5c0f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a9fd8-c12c-486c-a9f9-fa17fb5638b7]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:53 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:53 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4e18ca0c-9b4f-49d8-88d8-28a0b2c54186 tempest-CreateVolumesFromImageTest-1947604468 None] Created volume successfully. Apr 15 10:18:53 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 Apr 15 10:18:53 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:54 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:54 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 1G Apr 15 10:18:54 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-ac69fa2d-f00d-4033-84d1-5d195f19a22f-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-ac69fa2d-f00d-4033-84d1-5d195f19a22f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-quobyte-ac69fa2d-f00d-4033-84d1-5d195f19a22f" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-ac69fa2d-f00d-4033-84d1-5d195f19a22f" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbcc807-1218-4e99-8756-61cd114fcb1b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:54 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f Apr 15 10:18:54 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:54 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 1G" returned: 0 in 0.587s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:54 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:54 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 Apr 15 10:18:54 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:55 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f" returned: 0 in 0.570s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:55 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987" returned: 0 in 0.495s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:55 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 is being set with open permissions: ugo+rw Apr 15 10:18:55 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f Apr 15 10:18:55 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:55 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 Apr 15 10:18:55 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:55 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ac69fa2d-f00d-4033-84d1-5d195f19a22f" returned: 0 in 0.466s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-ac69fa2d-f00d-4033-84d1-5d195f19a22f" released by "delete_volume" :: held 1.059s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Created reservations ['0deed312-3831-429b-94da-c31072e0d3d2', '4fa9f702-a73a-4ff8-a9f2-dd355cf48f48', '13ee190a-6e52-4250-953c-249fe57718a6', '067bbb84-ac9a-4132-b9af-dbda5df8090c'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:55 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987" returned: 0 in 0.484s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:55 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.info Apr 15 10:18:55 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:55 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:55 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:55 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:56 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.info" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:56 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.info is being set with open permissions: ugo+rw Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:56 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.info Apr 15 10:18:56 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:56 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.465s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Deleted volume successfully. Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fc9595b2-0ac3-4f7b-ae9c-f51765b16064 tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-ac69fa2d-f00d-4033-84d1-5d195f19a22f-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:56 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.info" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.062s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.268s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Creating offline snapshot b3b5326f-43cf-4732-a2ba-2b37f452272d of volume 7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b78794b-2889-46d8-8948-dfd71e36a543]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:56 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-bdb8ff7e-54d2-4ddf-b33e-b498543af47c tempest-VolumeDependencyTests-1512334694 None] Create snapshot completed successfully Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=133,cinder:INSERT=39,cinder:UPDATE=160,cinder:DELETE=15 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-f1f6c379-8cea-4205-88ac-10cd27720803-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-f1f6c379-8cea-4205-88ac-10cd27720803-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:INSERT=39,cinder:UPDATE=156,cinder:SELECT=101,cinder:DELETE=13 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:18:56 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a Apr 15 10:18:56 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-quobyte-f1f6c379-8cea-4205-88ac-10cd27720803" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:56 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-f1f6c379-8cea-4205-88ac-10cd27720803" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:57 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7a285b-ad5e-4630-bffa-e32337fc8670]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:57 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 Apr 15 10:18:57 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:57 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" returned: 0 in 0.631s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:57 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d 1G Apr 15 10:18:57 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:57 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803" returned: 0 in 0.536s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:57 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:57 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803 Apr 15 10:18:57 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (c191497e-f6df-4ea2-9c9e-0ab182dfd322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d23fc0c-a404-4eac-8510-7801bf56e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d23fc0c-a404-4eac-8510-7801bf56e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1865763483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c3a518-52cd-471b-9842-3b21458e1063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4703530eb84fe5bdb5ddcfa071a28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b29daa25-17a5-42d7-b8ef-5f957d41b987,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:18:58Z,use_quota=True,user_id='c8f990ac40d84800a86ade15d8f41586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdc3f04-3ae2-4746-9143-3979538c0793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdc3f04-3ae2-4746-9143-3979538c0793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c220b33f-bf82-46f4-934d-529a9d57b5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c220b33f-bf82-46f4-934d-529a9d57b5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5c3a518-52cd-471b-9842-3b21458e1063', 'volume_name': 'volume-d5c3a518-52cd-471b-9842-3b21458e1063', 'volume_size': 1, 'snapshot_id': 'b29daa25-17a5-42d7-b8ef-5f957d41b987'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4d25e8-0440-4282-ad52-d274afae15a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d4d25e8-0440-4282-ad52-d274afae15a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:18:58 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea28555b-ed90-43d3-ab79-2322b68d2bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:18:58 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Volume d5c3a518-52cd-471b-9842-3b21458e1063: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5c3a518-52cd-471b-9842-3b21458e1063', 'volume_size': 1, 'snapshot_id': 'b29daa25-17a5-42d7-b8ef-5f957d41b987'} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d 1G" returned: 0 in 0.753s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:58 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d Apr 15 10:18:58 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:58 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f1f6c379-8cea-4205-88ac-10cd27720803" returned: 0 in 0.747s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-f1f6c379-8cea-4205-88ac-10cd27720803" released by "delete_volume" :: held 1.323s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Created reservations ['55dc6f2d-c621-4699-8bcc-9cf084665323', '85e70837-8bf5-4f3a-9d06-e4a267233c2d', '6cb4cc0f-d81b-4a99-9c8e-622be1376eaa', '9d16c958-fb3c-4118-a224-37b35d55a474'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:58 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:18:58 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:58 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d" returned: 0 in 0.499s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:58 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d is being set with open permissions: ugo+rw Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:58 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d Apr 15 10:18:58 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:58 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.509s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:18:58 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Deleted volume successfully. Apr 15 10:18:58 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-7ea5d0ea-054a-49dd-92f0-419feceb7a7b tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-f1f6c379-8cea-4205-88ac-10cd27720803-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-b4236ba9-e8c0-4560-b257-3a37236bd58e-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-b4236ba9-e8c0-4560-b257-3a37236bd58e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-quobyte-b4236ba9-e8c0-4560-b257-3a37236bd58e" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-b4236ba9-e8c0-4560-b257-3a37236bd58e" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[91432d46-74f9-4133-a942-0c3fd114654e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:59 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e Apr 15 10:18:59 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:59 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d" returned: 0 in 0.595s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:59 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.info Apr 15 10:18:59 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:59 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e" returned: 0 in 0.518s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:59 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e Apr 15 10:18:59 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:18:59 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.info" returned: 0 in 0.609s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:18:59 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.info is being set with open permissions: ugo+rw Apr 15 10:18:59 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:18:59 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.info Apr 15 10:18:59 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:00 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b4236ba9-e8c0-4560-b257-3a37236bd58e" returned: 0 in 0.489s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-b4236ba9-e8c0-4560-b257-3a37236bd58e" released by "delete_volume" :: held 1.035s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Created reservations ['45460276-f939-45fd-a5f5-d4171b6fe337', '9fcfba57-50f9-489d-9b7b-051a25d43ed7', '3cfbf7f9-9f32-4261-a292-f10d98bb22ed', 'de2fe623-d4da-4da8-8211-571e84df02d2'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:00 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:00 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:00 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.info" returned: 0 in 0.540s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.722s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.286s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-b29daa25-17a5-42d7-b8ef-5f957d41b987-d5c3a518-52cd-471b-9842-3b21458e1063" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Flow 'volume_create_manager' (bb625ee5-ae56-4f84-a451-70109d408ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55951e0e-1aa8-425c-bc14-61bdd854e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55951e0e-1aa8-425c-bc14-61bdd854e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2010662200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f245087-4f6a-44a2-9c2f-f34b94367ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64a2f73752f40f681ee525bda34b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:00Z,use_quota=True,user_id='2c6f0a3fc495403682cd50afbf7a18fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5d80ef-11f3-4a45-ab1e-1d5d39f6df7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5d80ef-11f3-4a45-ab1e-1d5d39f6df7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127519ee-8564-4f19-ad9f-cd8ee57c5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127519ee-8564-4f19-ad9f-cd8ee57c5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f245087-4f6a-44a2-9c2f-f34b94367ab9', 'volume_name': 'volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d705ee-6144-40ca-8a13-22aa7757c31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d705ee-6144-40ca-8a13-22aa7757c31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319296e6-a055-40d1-9bf0-83a0359216c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:00 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Volume 0f245087-4f6a-44a2-9c2f-f34b94367ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9', 'volume_size': 1} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-b29daa25-17a5-42d7-b8ef-5f957d41b987-d5c3a518-52cd-471b-9842-3b21458e1063" acquired by "_create_volume_from_snapshot" :: waited 0.088s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Creating volume d5c3a518-52cd-471b-9842-3b21458e1063 from snapshot b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-d5c3a518-52cd-471b-9842-3b21458e1063" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-be64fcaf-17d3-4cca-9d69-68d4eead1243 tempest-CreateVolumesFromSnapshotTest-213222752 None] Create snapshot completed successfully Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-d5c3a518-52cd-471b-9842-3b21458e1063" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] snapshot: b29daa25-17a5-42d7-b8ef-5f957d41b987, volume: d5c3a518-52cd-471b-9842-3b21458e1063, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[112882ac-b38d-4dc2-a4e3-85a97a3e66b2]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:00 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 Apr 15 10:19:00 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:00 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.486s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:00 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Deleted volume successfully. Apr 15 10:19:00 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-8d937ece-ac6a-4986-89f1-8ea21c65b2fa tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-b4236ba9-e8c0-4560-b257-3a37236bd58e-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (30faa743-e8ea-4c4e-9f22-24243739fb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95897c1a-4a1b-4146-a4c8-adf070ba421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95897c1a-4a1b-4146-a4c8-adf070ba421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1007987651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e7ea6d-63e2-4fd3-8fe6-044d68938bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:01Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7748744b-3d64-498d-a50b-1586e495fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7748744b-3d64-498d-a50b-1586e495fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c7b794-73bb-45eb-9e1a-a5c312cb4ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c7b794-73bb-45eb-9e1a-a5c312cb4ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e7ea6d-63e2-4fd3-8fe6-044d68938bad', 'volume_name': 'volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94070570-2175-46d0-bd8f-095d1fa74526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94070570-2175-46d0-bd8f-095d1fa74526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd5239b-66c9-4a8e-9d38-20667d80da2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume 21e7ea6d-63e2-4fd3-8fe6-044d68938bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad', 'volume_size': 1} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:01 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (ac4f55fd-86fa-4c51-809d-647aee575ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf25bf1a-8d62-4354-ad0f-f5a70854639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987" returned: 0 in 0.647s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e373d29-dd79-45ab-8422-e79d7ce57a70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260c76e-8c2d-4a7b-9177-b05ebf47e60f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf25bf1a-8d62-4354-ad0f-f5a70854639e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039395083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4bc299-aea9-4002-9a58-b16d431e1cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:01Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75fe263-99f8-49ac-bda6-7d993fdfbfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75fe263-99f8-49ac-bda6-7d993fdfbfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb908eb7-0503-4e2c-807c-43c5ad7ba872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb908eb7-0503-4e2c-807c-43c5ad7ba872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4bc299-aea9-4002-9a58-b16d431e1cdf', 'volume_name': 'volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d215041f-5458-4b87-8cc3-d1373149a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d215041f-5458-4b87-8cc3-d1373149a03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62a2cd1-2b0a-427e-9540-200d400b46be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume 3c4bc299-aea9-4002-9a58-b16d431e1cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf', 'volume_size': 1} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-873b2d91-10a7-4786-8c02-9994d08d4362-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-873b2d91-10a7-4786-8c02-9994d08d4362-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-quobyte-873b2d91-10a7-4786-8c02-9994d08d4362" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-873b2d91-10a7-4786-8c02-9994d08d4362" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[44405de9-c3be-4b16-a4e9-9103e6cafff0]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:01 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 Apr 15 10:19:01 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (75e23ea3-06eb-4c98-b843-4eac4eac4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3365f851-c9fb-404e-b270-9b08d0fb249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3365f851-c9fb-404e-b270-9b08d0fb249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255561924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5cb895-1268-4e25-9e5c-2c5ffa81c83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:01Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f71983-6ba3-44c5-ba72-6c8b66592210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f71983-6ba3-44c5-ba72-6c8b66592210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfc5738-457a-4a00-ba2e-659a5afafd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfc5738-457a-4a00-ba2e-659a5afafd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5cb895-1268-4e25-9e5c-2c5ffa81c83c', 'volume_name': 'volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417ce366-fc35-489f-a846-900bfb80402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417ce366-fc35-489f-a846-900bfb80402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dd7123-7d2d-451e-8b6b-7da1bc6b94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume ec5cb895-1268-4e25-9e5c-2c5ffa81c83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c', 'volume_size': 1} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:01 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 Apr 15 10:19:01 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (596bf17f-25c4-4c97-ae40-a59a9e063a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602daeaa-ed0f-49ad-bbc5-6c6f4bb04359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602daeaa-ed0f-49ad-bbc5-6c6f4bb04359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-966982549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd65720a-61ca-4ac2-be7f-3efbf80432a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:02Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7c47c6-8ddd-4a40-9993-ddd61da6cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7c47c6-8ddd-4a40-9993-ddd61da6cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404343b6-65ee-4388-8bbc-e190105c5779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404343b6-65ee-4388-8bbc-e190105c5779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd65720a-61ca-4ac2-be7f-3efbf80432a6', 'volume_name': 'volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e1a2b9-a63b-4b88-bbb9-99eedfb87a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e1a2b9-a63b-4b88-bbb9-99eedfb87a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f377d56-0992-4543-a6bc-4b595a2a1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume dd65720a-61ca-4ac2-be7f-3efbf80432a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6', 'volume_size': 1} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (d18feb91-2f9f-4232-a44d-ab8308371988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e321aa-2adb-4282-afcc-552b434169d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e321aa-2adb-4282-afcc-552b434169d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142099781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494e97ca-7e1a-43f0-8bce-c90beaa51c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:02Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212eeeb3-8013-4c22-aa63-29cd6b6ef0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212eeeb3-8013-4c22-aa63-29cd6b6ef0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb9ddba-5344-450b-837c-99bc62bf2324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb9ddba-5344-450b-837c-99bc62bf2324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '494e97ca-7e1a-43f0-8bce-c90beaa51c29', 'volume_name': 'volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b814a43-cd37-4ab2-b842-2c01b0eb0e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b814a43-cd37-4ab2-b842-2c01b0eb0e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa3dccd-ea9b-4c6a-b5a7-bbdb7d70ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:01 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume 494e97ca-7e1a-43f0-8bce-c90beaa51c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29', 'volume_size': 1} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:01 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70" returned: 0 in 0.653s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:19:01 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:01 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 Apr 15 10:19:01 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:02 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362" returned: 0 in 0.589s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:02 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362 Apr 15 10:19:02 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:02 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-873b2d91-10a7-4786-8c02-9994d08d4362" returned: 0 in 0.491s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-873b2d91-10a7-4786-8c02-9994d08d4362" released by "delete_volume" :: held 1.132s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Created reservations ['52714596-f0ba-493e-9de9-e7dd26050815', '84285247-7340-4c27-a736-5a57a8c71aaa', '49bddca3-c2cb-41ec-8852-9ae864c7a240', '56bd2e94-7616-4eef-9da1-b75237d44a28'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:02 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:02 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:02 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-a91708f3-201d-44d8-b9d5-1d81ec24a374-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:03 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.973s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-a91708f3-201d-44d8-b9d5-1d81ec24a374-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:03 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Deleted volume successfully. Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "cinder-quobyte-a91708f3-201d-44d8-b9d5-1d81ec24a374" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-09dcde46-8af2-4668-b2cf-4266bc740d6c tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-873b2d91-10a7-4786-8c02-9994d08d4362-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-a91708f3-201d-44d8-b9d5-1d81ec24a374" acquired by "delete_volume" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7bd403-a025-4afa-91a3-b0f28ec83450]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:03 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:04 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 Apr 15 10:19:04 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:04 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063" returned: 0 in 2.158s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b16593-04c5-4ad6-929a-b06f8f33bc9d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:04 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 Apr 15 10:19:04 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:04 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374" returned: 0 in 0.539s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:04 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374 Apr 15 10:19:04 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:04 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70" returned: 0 in 0.640s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:19:04 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Converted 1024.00 MB image at 474.17 MB/s Apr 15 10:19:04 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 is being set with open permissions: ugo+rw Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:04 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 Apr 15 10:19:04 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:04 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-a91708f3-201d-44d8-b9d5-1d81ec24a374" returned: 0 in 0.448s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:04 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-quobyte-a91708f3-201d-44d8-b9d5-1d81ec24a374" released by "delete_volume" :: held 1.028s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Created reservations ['b96c51cb-5d51-4578-a322-f753c29db12b', '25e213e0-30e5-404f-a07c-93c515cc2ae7', '66ceb666-3fe6-44a7-9d96-b1ea85cacb61', '7019de12-a7a8-42eb-80cd-707a6e12065e'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:05 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:05 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:05 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063" returned: 0 in 0.483s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-d5c3a518-52cd-471b-9842-3b21458e1063" released by "_copy_volume_from_snapshot" :: held 4.646s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-b29daa25-17a5-42d7-b8ef-5f957d41b987-d5c3a518-52cd-471b-9842-3b21458e1063" released by "_create_volume_from_snapshot" :: held 4.668s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.757s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.688s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2010662200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f245087-4f6a-44a2-9c2f-f34b94367ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64a2f73752f40f681ee525bda34b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:00Z,use_quota=True,user_id='2c6f0a3fc495403682cd50afbf7a18fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Creating volume 0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:05 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:05 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 1073741824 Apr 15 10:19:05 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea28555b-ed90-43d3-ab79-2322b68d2bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c3a518-52cd-471b-9842-3b21458e1063', 'volume_size': 1, 'snapshot_id': 'b29daa25-17a5-42d7-b8ef-5f957d41b987'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1030f25-f036-4083-b520-3687695e8f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:05 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Volume volume-d5c3a518-52cd-471b-9842-3b21458e1063 (d5c3a518-52cd-471b-9842-3b21458e1063): created successfully Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1030f25-f036-4083-b520-3687695e8f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (c191497e-f6df-4ea2-9c9e-0ab182dfd322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d4030218-f40d-4762-bde3-715c1d10d0d0 tempest-VolumeDependencyTests-1512334694 None] Created volume successfully. Apr 15 10:19:05 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.427s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:05 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Deleted volume successfully. Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-59acd17e-c2d2-4423-bf55-67be86189ade tempest-CreateVolumesFromImageTest-1947604468 None] Lock "cinder-a91708f3-201d-44d8-b9d5-1d81ec24a374-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-b29daa25-17a5-42d7-b8ef-5f957d41b987-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-b29daa25-17a5-42d7-b8ef-5f957d41b987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-5e373d29-dd79-45ab-8422-e79d7ce57a70" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-5e373d29-dd79-45ab-8422-e79d7ce57a70" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-b29daa25-17a5-42d7-b8ef-5f957d41b987" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-b29daa25-17a5-42d7-b8ef-5f957d41b987" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Deleting offline snapshot b29daa25-17a5-42d7-b8ef-5f957d41b987 of volume 5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] snapshot_file for this snap is: volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e394fe-14d7-4a72-8b09-b51adfaf8e5f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:05 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 Apr 15 10:19:05 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:05 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 1073741824" returned: 0 in 0.523s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:05 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:05 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 Apr 15 10:19:05 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:06 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987" returned: 0 in 0.527s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e373d29-dd79-45ab-8422-e79d7ce57a70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40054c5-34fc-42c0-9b38-fdc9fd69e9d6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:06 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 Apr 15 10:19:06 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:06 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9" returned: 0 in 0.529s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.243s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1007987651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e7ea6d-63e2-4fd3-8fe6-044d68938bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:01Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Creating volume 21e7ea6d-63e2-4fd3-8fe6-044d68938bad {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:06 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:06 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad 1073741824 Apr 15 10:19:06 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (319296e6-a055-40d1-9bf0-83a0359216c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53841c0e-b7c4-4c8d-85a6-8ebb2bd48683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:06 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Volume volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 (0f245087-4f6a-44a2-9c2f-f34b94367ab9): created successfully Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53841c0e-b7c4-4c8d-85a6-8ebb2bd48683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Flow 'volume_create_manager' (bb625ee5-ae56-4f84-a451-70109d408ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:06 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c0844f71-2160-4bd0-8475-ba0c6169339c tempest-SnapshotDependencyTests-134055878 None] Created volume successfully. Apr 15 10:19:06 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70" returned: 0 in 0.586s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:06 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:06 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 Apr 15 10:19:06 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:07 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad 1073741824" returned: 0 in 0.716s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:07 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad Apr 15 10:19:07 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:07 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987" returned: 0 in 0.591s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:07 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987 Apr 15 10:19:07 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:07 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad" returned: 0 in 0.535s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.304s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039395083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4bc299-aea9-4002-9a58-b16d431e1cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:01Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Creating volume 3c4bc299-aea9-4002-9a58-b16d431e1cdf {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:07 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd5239b-66c9-4a8e-9d38-20667d80da2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501c1d28-bac3-4ea8-a2e5-9a3243a2116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:07 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf 1073741824 Apr 15 10:19:07 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:07 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad (21e7ea6d-63e2-4fd3-8fe6-044d68938bad): created successfully Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501c1d28-bac3-4ea8-a2e5-9a3243a2116e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (30faa743-e8ea-4c4e-9f22-24243739fb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-074e1fdf-df33-4a68-a201-9ead07413edc tempest-CreateVolumesFromSnapshotTest-213222752 None] Created volume successfully. Apr 15 10:19:07 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70.b29daa25-17a5-42d7-b8ef-5f957d41b987" returned: 0 in 0.488s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-b29daa25-17a5-42d7-b8ef-5f957d41b987" released by "_delete_snapshot" :: held 2.264s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-5e373d29-dd79-45ab-8422-e79d7ce57a70" released by "delete_snapshot" :: held 2.280s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Created reservations ['85f5073c-b4b3-49d0-a0fe-563238d1fd8c', 'ea869d70-787f-4f0a-8610-1ff0d9410ee6', '4e29465c-3976-4473-a140-4eb84c6009cc', '8e2059c7-386a-4a43-a826-90a6d4ca8c35'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:07 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Delete snapshot completed successfully. Apr 15 10:19:07 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-66bffd61-aa66-4e10-8908-624b2fb58f94 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-b29daa25-17a5-42d7-b8ef-5f957d41b987-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:08 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf 1073741824" returned: 0 in 0.555s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:08 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf Apr 15 10:19:08 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (b80e55e4-e580-419b-8f0f-850260f56f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ca9faa-3fda-4506-90d1-4f31d36d8e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ca9faa-3fda-4506-90d1-4f31d36d8e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135004512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bf7740-70e2-4d33-be1e-c42e44d93ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:08Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfaac43-4642-4a4a-9fbe-eb5ac1e88972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfaac43-4642-4a4a-9fbe-eb5ac1e88972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b527605-5c2a-48db-b2a2-7f5e6454e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b527605-5c2a-48db-b2a2-7f5e6454e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bf7740-70e2-4d33-be1e-c42e44d93ffd', 'volume_name': 'volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c587d20b-f2e8-4130-ba15-4591c0b373b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c587d20b-f2e8-4130-ba15-4591c0b373b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0153dc6-1338-4fe3-880b-5b649692875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:08 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume 32bf7740-70e2-4d33-be1e-c42e44d93ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd', 'volume_size': 1} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:08 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf" returned: 0 in 0.394s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.128s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255561924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5cb895-1268-4e25-9e5c-2c5ffa81c83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:01Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Creating volume ec5cb895-1268-4e25-9e5c-2c5ffa81c83c {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:08 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:08 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c 1073741824 Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62a2cd1-2b0a-427e-9540-200d400b46be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:08 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cc8cc0-b53f-4751-bcb7-e7b33a62224a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:08 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf (3c4bc299-aea9-4002-9a58-b16d431e1cdf): created successfully Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cc8cc0-b53f-4751-bcb7-e7b33a62224a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (ac4f55fd-86fa-4c51-809d-647aee575ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:08 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-bcfbb8d1-4e48-4cb8-9186-ce7354d84e31 tempest-CreateVolumesFromSnapshotTest-213222752 None] Created volume successfully. Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-5e373d29-dd79-45ab-8422-e79d7ce57a70-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-5e373d29-dd79-45ab-8422-e79d7ce57a70-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-5e373d29-dd79-45ab-8422-e79d7ce57a70" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-5e373d29-dd79-45ab-8422-e79d7ce57a70" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3e3787-3f71-4bce-9e4e-857c55d2efab]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:08 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:08 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 Apr 15 10:19:08 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:09 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c 1073741824" returned: 0 in 0.489s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:09 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c Apr 15 10:19:09 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:09 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70" returned: 0 in 0.535s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:09 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70 Apr 15 10:19:09 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:09 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.869s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-966982549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd65720a-61ca-4ac2-be7f-3efbf80432a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:02Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Creating volume dd65720a-61ca-4ac2-be7f-3efbf80432a6 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:09 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02dd7123-7d2d-451e-8b6b-7da1bc6b94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:09 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 1073741824 Apr 15 10:19:09 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c346ac55-b059-48f3-ac84-b4976936180a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:09 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c (ec5cb895-1268-4e25-9e5c-2c5ffa81c83c): created successfully Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c346ac55-b059-48f3-ac84-b4976936180a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (75e23ea3-06eb-4c98-b843-4eac4eac4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:09 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fca7d4ca-9a0d-449d-a8db-88f62f356ee1 tempest-CreateVolumesFromSnapshotTest-213222752 None] Created volume successfully. Apr 15 10:19:09 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-5e373d29-dd79-45ab-8422-e79d7ce57a70" returned: 0 in 0.453s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-5e373d29-dd79-45ab-8422-e79d7ce57a70" released by "delete_volume" :: held 1.027s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Created reservations ['c86a1de5-7195-461c-a412-9ddc78cb1632', '2fca45af-eac3-4c83-afda-a51cd54a7ff8', '6345bd72-fda0-4116-9802-4315f26fb106', '6f9a6647-b937-4ad8-938b-7099fb621c0d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:09 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:09 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:09 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:10 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 1073741824" returned: 0 in 0.491s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:10 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 Apr 15 10:19:10 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:10 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.429s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Deleted volume successfully. Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-db4095da-1e96-4c0d-a94c-2ada8b8990e3 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-5e373d29-dd79-45ab-8422-e79d7ce57a70-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:10 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6" returned: 0 in 0.422s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.686s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142099781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494e97ca-7e1a-43f0-8bce-c90beaa51c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b0514ceeece455c90fae0fc334463f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:02Z,use_quota=True,user_id='6391485d09f04a7b970b0e88bcc7bd2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Creating volume 494e97ca-7e1a-43f0-8bce-c90beaa51c29 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:10 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f377d56-0992-4543-a6bc-4b595a2a1421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:10 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 1073741824 Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844dd904-4c2f-4127-9db8-ccc372e58fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:10 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:10 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 (dd65720a-61ca-4ac2-be7f-3efbf80432a6): created successfully Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844dd904-4c2f-4127-9db8-ccc372e58fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:10 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (596bf17f-25c4-4c97-ae40-a59a9e063a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:10 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-8a3e6da6-b6ef-4c99-8501-bc3a52e2ae63 tempest-CreateVolumesFromSnapshotTest-213222752 None] Created volume successfully. Apr 15 10:19:11 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 1073741824" returned: 0 in 0.517s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:11 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 Apr 15 10:19:11 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (eb65bc79-e57c-4a55-86c6-259dacc4f61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3185568e-aa38-4912-8b1b-65bc522faf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3185568e-aa38-4912-8b1b-65bc522faf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-14731820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76068778-28cc-4f3b-9761-aee6a0b34cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4703530eb84fe5bdb5ddcfa071a28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:11Z,use_quota=True,user_id='c8f990ac40d84800a86ade15d8f41586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bf48e0-3c7d-4cf8-a28b-b267301eb1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45bf48e0-3c7d-4cf8-a28b-b267301eb1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76598c5-1023-4b82-bd08-5119de268b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76598c5-1023-4b82-bd08-5119de268b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76068778-28cc-4f3b-9761-aee6a0b34cf8', 'volume_name': 'volume-76068778-28cc-4f3b-9761-aee6a0b34cf8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3eca731-e569-441a-818a-dea113a5fe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3eca731-e569-441a-818a-dea113a5fe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85ca5ff-cf9b-4f34-a5ef-0d3f3d079705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:11 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Volume 76068778-28cc-4f3b-9761-aee6a0b34cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76068778-28cc-4f3b-9761-aee6a0b34cf8', 'volume_size': 1} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:11 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29" returned: 0 in 0.421s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.268s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa3dccd-ea9b-4c6a-b5a7-bbdb7d70ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbaa57b-7b41-43ee-84ee-ec7ec460b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Creating offline snapshot 6d5a645b-79a5-47d5-a3e5-c67360534876 of volume 0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:19:11 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Volume volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 (494e97ca-7e1a-43f0-8bce-c90beaa51c29): created successfully Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbaa57b-7b41-43ee-84ee-ec7ec460b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Flow 'volume_create_manager' (d18feb91-2f9f-4232-a44d-ab8308371988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd92c80-83b0-4aa3-9640-c24c4c774011]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:11 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-c609f7e9-fa54-4ce7-ac69-5c20d291913a tempest-CreateVolumesFromSnapshotTest-213222752 None] Created volume successfully. Apr 15 10:19:11 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 Apr 15 10:19:11 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-494e97ca-7e1a-43f0-8bce-c90beaa51c29-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-494e97ca-7e1a-43f0-8bce-c90beaa51c29-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-494e97ca-7e1a-43f0-8bce-c90beaa51c29" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-494e97ca-7e1a-43f0-8bce-c90beaa51c29" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e0b485-82ed-442c-8aa2-0328f5cad093]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:11 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:11 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 Apr 15 10:19:11 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:12 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9" returned: 0 in 0.508s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:12 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 1G Apr 15 10:19:12 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:12 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29" returned: 0 in 0.505s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:12 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29 Apr 15 10:19:12 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:12 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 1G" returned: 0 in 0.503s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:12 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 Apr 15 10:19:12 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:12 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-494e97ca-7e1a-43f0-8bce-c90beaa51c29" returned: 0 in 0.441s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-494e97ca-7e1a-43f0-8bce-c90beaa51c29" released by "delete_volume" :: held 0.968s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Created reservations ['49f06f9f-bc9f-4b58-b579-8992a0a50624', 'fcde533d-cbd4-4fc6-b9bd-b6e8f0e27833', '39a949bf-46a8-4518-9553-18b71eb9af62', 'e07add18-4b04-4f30-83f7-6b63b8a07d96'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:12 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:12 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:12 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:13 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876" returned: 0 in 0.455s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:13 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 is being set with open permissions: ugo+rw Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:13 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 Apr 15 10:19:13 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:13 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.441s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:13 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Deleted volume successfully. Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-9885f534-3653-4d83-b3f8-3d6e0ca42a08 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-494e97ca-7e1a-43f0-8bce-c90beaa51c29-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:13 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876" returned: 0 in 0.440s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:13 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.info Apr 15 10:19:13 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-dd65720a-61ca-4ac2-be7f-3efbf80432a6-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-dd65720a-61ca-4ac2-be7f-3efbf80432a6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-dd65720a-61ca-4ac2-be7f-3efbf80432a6" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-dd65720a-61ca-4ac2-be7f-3efbf80432a6" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb736e-2184-48f6-9887-e73addb8f841]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:13 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:14 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.info" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:14 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.info is being set with open permissions: ugo+rw Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:14 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 Apr 15 10:19:14 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:14 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.info Apr 15 10:19:14 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:14 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.info" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.108s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135004512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bf7740-70e2-4d33-be1e-c42e44d93ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:08Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Creating volume 32bf7740-70e2-4d33-be1e-c42e44d93ffd {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:14 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:14 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:14 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd 1073741824 Apr 15 10:19:14 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6" returned: 0 in 0.549s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:14 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6 Apr 15 10:19:14 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:14 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-6269acf9-be01-42bf-8194-aac9a0761f51 tempest-SnapshotDependencyTests-134055878 None] Create snapshot completed successfully Apr 15 10:19:14 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-dd65720a-61ca-4ac2-be7f-3efbf80432a6" returned: 0 in 0.413s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-dd65720a-61ca-4ac2-be7f-3efbf80432a6" released by "delete_volume" :: held 0.987s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:14 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:14 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd 1073741824" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Created reservations ['ce02df91-3c30-435b-bedc-1451b4033405', '5707e0a6-c494-478a-b8a7-f65cdeeb761d', '09714c5f-1372-4bc4-ac14-26d9502a5e6e', '2ec307e3-f684-4579-8935-d56bbff6abea'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:15 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd Apr 15 10:19:15 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:15 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:15 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:15 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd" returned: 0 in 0.392s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.186s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-14731820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76068778-28cc-4f3b-9761-aee6a0b34cf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4703530eb84fe5bdb5ddcfa071a28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:11Z,use_quota=True,user_id='c8f990ac40d84800a86ade15d8f41586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Creating volume 76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:15 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0153dc6-1338-4fe3-880b-5b649692875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d65b13-5b2f-4d46-b472-f9aeb6ceba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:15 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 1073741824 Apr 15 10:19:15 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:15 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd (32bf7740-70e2-4d33-be1e-c42e44d93ffd): created successfully Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d65b13-5b2f-4d46-b472-f9aeb6ceba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (b80e55e4-e580-419b-8f0f-850260f56f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b89ed559-b277-48d9-bc12-f19e1f237b70 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created volume successfully. Apr 15 10:19:15 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.449s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:15 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Deleted volume successfully. Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-50dc20c0-795e-42d2-ab6a-82f2bf7a6d1e tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-dd65720a-61ca-4ac2-be7f-3efbf80432a6-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (853e3947-8d8a-4ad5-94cb-c3ee7f0bf882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:15 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39164664-7ce7-430e-a99d-a6d6582cdf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39164664-7ce7-430e-a99d-a6d6582cdf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488464477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce63d98-2ad1-47d4-abc8-f288060ba7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:16Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64c5de0-6737-4e1f-92a4-8c4815373fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64c5de0-6737-4e1f-92a4-8c4815373fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd6b7cb-83c4-4988-8617-36107f77aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd6b7cb-83c4-4988-8617-36107f77aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce63d98-2ad1-47d4-abc8-f288060ba7f0', 'volume_name': 'volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898aaf03-b4ec-4bbd-90e1-dc0cba8e680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898aaf03-b4ec-4bbd-90e1-dc0cba8e680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150e3702-893f-4a40-b9e2-f2eddd0bb65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume 1ce63d98-2ad1-47d4-abc8-f288060ba7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0', 'volume_size': 1} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 1073741824" returned: 0 in 0.598s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:16 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 Apr 15 10:19:16 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Flow 'volume_create_manager' (aaac3e27-5316-4fb9-bc93-fba6c144e2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f195e5-b819-4baa-90e9-be8b3e72ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f195e5-b819-4baa-90e9-be8b3e72ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0085b7-e227-4504-a88a-ba4430489c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64a2f73752f40f681ee525bda34b9cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d5a645b-79a5-47d5-a3e5-c67360534876,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:16Z,use_quota=True,user_id='2c6f0a3fc495403682cd50afbf7a18fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7617b0b2-4dd4-44a5-a00e-f235570607ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7617b0b2-4dd4-44a5-a00e-f235570607ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a5ba20-1079-4bae-b638-0b90bd9ed894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a5ba20-1079-4bae-b638-0b90bd9ed894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e0085b7-e227-4504-a88a-ba4430489c89', 'volume_name': 'volume-6e0085b7-e227-4504-a88a-ba4430489c89', 'volume_size': 1, 'snapshot_id': '6d5a645b-79a5-47d5-a3e5-c67360534876'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ded3567-43bf-4cde-829f-314f9a6e3260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ded3567-43bf-4cde-829f-314f9a6e3260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bc77b5-06b4-45d6-bc43-53d517706df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Volume 6e0085b7-e227-4504-a88a-ba4430489c89: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e0085b7-e227-4504-a88a-ba4430489c89', 'volume_size': 1, 'snapshot_id': '6d5a645b-79a5-47d5-a3e5-c67360534876'} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (f7ba6592-68a3-43e5-b273-b0fbb9133bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73624e13-3506-45a0-a719-390b86356955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c" acquired by "delete_volume" :: waited 0.043s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b66f0b-db8b-42ac-9d80-e82cac8dae06]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73624e13-3506-45a0-a719-390b86356955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589756432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a6e359-72ad-4bca-afe8-95b25356e790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:16Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bafa05f-f56a-4186-98a1-7dc09be3674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bafa05f-f56a-4186-98a1-7dc09be3674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4130ad-b3cd-4b74-b6c7-43e45534cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4130ad-b3cd-4b74-b6c7-43e45534cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a6e359-72ad-4bca-afe8-95b25356e790', 'volume_name': 'volume-f7a6e359-72ad-4bca-afe8-95b25356e790', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545164ae-ba34-42e7-9d3c-8e2eb59287b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545164ae-ba34-42e7-9d3c-8e2eb59287b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ac72b7-5d4e-4fbf-aa6e-74eb461d172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume f7a6e359-72ad-4bca-afe8-95b25356e790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a6e359-72ad-4bca-afe8-95b25356e790', 'volume_size': 1} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:16 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c Apr 15 10:19:16 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (3b763d17-7991-4cfa-855f-42dfa6849c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ba9d56-95f7-4d0f-a25f-a1041f294b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ba9d56-95f7-4d0f-a25f-a1041f294b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556664922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e3c05e-c7f3-4581-894c-bc5ca85c496b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:16Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16626ffc-444e-4304-981e-3a534452bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16626ffc-444e-4304-981e-3a534452bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea96e77-9fe2-439c-aaa2-05ab8c08e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea96e77-9fe2-439c-aaa2-05ab8c08e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e3c05e-c7f3-4581-894c-bc5ca85c496b', 'volume_name': 'volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d17d4bc-0738-4ed9-b696-26488011c2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d17d4bc-0738-4ed9-b696-26488011c2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069af2a7-ae66-49d4-99cb-c7614edcf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume 19e3c05e-c7f3-4581-894c-bc5ca85c496b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b', 'volume_size': 1} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:16 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8" returned: 0 in 0.558s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488464477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce63d98-2ad1-47d4-abc8-f288060ba7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:16Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Creating volume 1ce63d98-2ad1-47d4-abc8-f288060ba7f0 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85ca5ff-cf9b-4f34-a5ef-0d3f3d079705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76068778-28cc-4f3b-9761-aee6a0b34cf8', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a5f560-3a37-4e01-bac6-f19b7ed09a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 1073741824 Apr 15 10:19:16 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Volume volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 (76068778-28cc-4f3b-9761-aee6a0b34cf8): created successfully Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a5f560-3a37-4e01-bac6-f19b7ed09a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (eb65bc79-e57c-4a55-86c6-259dacc4f61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (4c5d49b2-5edd-481e-8533-7717dd27ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b940709-f890-4871-889d-51da9778907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9030dc78-572f-40e5-b298-7f888fb97f39 tempest-VolumeDependencyTests-1512334694 None] Created volume successfully. Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b940709-f890-4871-889d-51da9778907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601971512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73214d6-b9b8-43be-ba36-0a50328c5252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:17Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3924c49-a862-400f-9ead-703802c59342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3924c49-a862-400f-9ead-703802c59342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767d40b1-b0f4-4d6f-804c-919f46d16817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767d40b1-b0f4-4d6f-804c-919f46d16817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73214d6-b9b8-43be-ba36-0a50328c5252', 'volume_name': 'volume-b73214d6-b9b8-43be-ba36-0a50328c5252', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd290a98-ee45-4549-83a7-7d4619e5d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd290a98-ee45-4549-83a7-7d4619e5d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6cb02-53bd-4e98-ab66-ba574bd0c6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume b73214d6-b9b8-43be-ba36-0a50328c5252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73214d6-b9b8-43be-ba36-0a50328c5252', 'volume_size': 1} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (ebd3f05c-4890-4fab-9ad2-1231d5df1729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef4936e-7c93-4710-bd8b-bc494809a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef4936e-7c93-4710-bd8b-bc494809a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1437380093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf9dc4d-4919-43e9-bf13-fb190f949386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:17Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea26901-96be-40df-b32d-e0eb1b44c462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea26901-96be-40df-b32d-e0eb1b44c462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593e3078-9d5e-41a3-8a31-a393426b4420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593e3078-9d5e-41a3-8a31-a393426b4420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf9dc4d-4919-43e9-bf13-fb190f949386', 'volume_name': 'volume-2bf9dc4d-4919-43e9-bf13-fb190f949386', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de55515-9e8e-4d67-adae-7e57e756954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de55515-9e8e-4d67-adae-7e57e756954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfd6a83-5cf9-45fc-bbd5-4baffbcc57a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:16 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume 2bf9dc4d-4919-43e9-bf13-fb190f949386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf9dc4d-4919-43e9-bf13-fb190f949386', 'volume_size': 1} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c" returned: 0 in 0.694s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:16 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:17 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c Apr 15 10:19:17 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:17 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 1073741824" returned: 0 in 0.623s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:17 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 Apr 15 10:19:17 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:17 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c" returned: 0 in 0.424s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c" released by "delete_volume" :: held 1.152s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Created reservations ['ccfc2040-1cba-43ca-9ebc-746b5acb598c', '6cdf0d31-04a0-4d24-821c-6aad95e32f0c', '0708268a-063a-4079-81ec-726cf017f126', '7c6217a9-92f6-4820-9d2c-93c1c96e6cd7'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:17 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:17 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:17 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0" returned: 0 in 0.477s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.570s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-quobyte-6d5a645b-79a5-47d5-a3e5-c67360534876-6e0085b7-e227-4504-a88a-ba4430489c89" by "_create_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (150e3702-893f-4a40-b9e2-f2eddd0bb65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aab75b-d833-478b-afba-c9c124cb574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 (1ce63d98-2ad1-47d4-abc8-f288060ba7f0): created successfully Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aab75b-d833-478b-afba-c9c124cb574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (853e3947-8d8a-4ad5-94cb-c3ee7f0bf882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6d5a645b-79a5-47d5-a3e5-c67360534876-6e0085b7-e227-4504-a88a-ba4430489c89" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Creating volume 6e0085b7-e227-4504-a88a-ba4430489c89 from snapshot 6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-quobyte-6e0085b7-e227-4504-a88a-ba4430489c89" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3660a33c-ff4f-40d8-97e0-a383d247ca2b tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created volume successfully. Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6e0085b7-e227-4504-a88a-ba4430489c89" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] snapshot: 6d5a645b-79a5-47d5-a3e5-c67360534876, volume: 6e0085b7-e227-4504-a88a-ba4430489c89, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (b9c91236-5b3b-43a2-b02d-a9cdd7ed46bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e16007b-7dee-4557-a4dd-5362bc53e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[57136a7f-71c0-4a83-8645-cf1f5815c74d]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e16007b-7dee-4557-a4dd-5362bc53e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1039736075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4893db7c-5c54-4f14-b89a-4d35506195d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4703530eb84fe5bdb5ddcfa071a28f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=76068778-28cc-4f3b-9761-aee6a0b34cf8,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:18Z,use_quota=True,user_id='c8f990ac40d84800a86ade15d8f41586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e2c45d-d3bf-40a8-b9ce-022ff4ff5d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e2c45d-d3bf-40a8-b9ce-022ff4ff5d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711d2e43-fa81-40f5-a1a7-a4de22af7683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711d2e43-fa81-40f5-a1a7-a4de22af7683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4893db7c-5c54-4f14-b89a-4d35506195d3', 'volume_name': 'volume-4893db7c-5c54-4f14-b89a-4d35506195d3', 'volume_size': 1, 'source_volid': '76068778-28cc-4f3b-9761-aee6a0b34cf8', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb2602b-8feb-461f-adb3-074ee3040150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb2602b-8feb-461f-adb3-074ee3040150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4a2747-9c0b-4240-b70a-fcfb3220bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:17 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Volume 4893db7c-5c54-4f14-b89a-4d35506195d3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4893db7c-5c54-4f14-b89a-4d35506195d3', 'volume_size': 1, 'source_volid': '76068778-28cc-4f3b-9761-aee6a0b34cf8', 'source_volstatus': 'available'} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:17 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.438s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:17 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Deleted volume successfully. Apr 15 10:19:17 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-90362879-21d3-4985-9a34-4784acfa968c tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-ec5cb895-1268-4e25-9e5c-2c5ffa81c83c-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:17 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 Apr 15 10:19:17 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-3c4bc299-aea9-4002-9a58-b16d431e1cdf-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-3c4bc299-aea9-4002-9a58-b16d431e1cdf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-3c4bc299-aea9-4002-9a58-b16d431e1cdf" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-3c4bc299-aea9-4002-9a58-b16d431e1cdf" acquired by "delete_volume" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d6b83f-2437-4c5a-a3f5-5e4f28ee87ab]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:18 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf Apr 15 10:19:18 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:18 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876" returned: 0 in 0.529s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f096b9c-40c2-4757-aedb-f5bc963580c0]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:18 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 Apr 15 10:19:18 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:18 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:18 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf Apr 15 10:19:18 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:18 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9" returned: 0 in 0.483s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:19:18 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:18 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 Apr 15 10:19:18 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:19 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-3c4bc299-aea9-4002-9a58-b16d431e1cdf" returned: 0 in 0.448s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-3c4bc299-aea9-4002-9a58-b16d431e1cdf" released by "delete_volume" :: held 0.934s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Created reservations ['ad6105fa-eb60-4300-80bf-c60556b2caf3', '666b0de8-f801-4c14-9f51-d0d7b64b70af', '405b0239-bfe5-4cf6-bbe5-477c3de4a14c', 'bb5662e5-be66-4a27-b674-47ffda4017c3'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:19 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:19 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-21e7ea6d-63e2-4fd3-8fe6-044d68938bad-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-21e7ea6d-63e2-4fd3-8fe6-044d68938bad-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-21e7ea6d-63e2-4fd3-8fe6-044d68938bad" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-21e7ea6d-63e2-4fd3-8fe6-044d68938bad" acquired by "delete_volume" :: waited 0.028s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051514a-4874-464a-aeb3-02101533541f]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:19 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:19 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad Apr 15 10:19:19 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:20 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:20 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.982s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:20 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:20 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Deleted volume successfully. Apr 15 10:19:20 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f85a8c7b-39f0-436b-8497-a0bd9150a49d tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-3c4bc299-aea9-4002-9a58-b16d431e1cdf-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:21 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad" returned: 0 in 1.508s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:21 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad Apr 15 10:19:21 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:21 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89" returned: 0 in 2.236s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f607c5-b7e3-47c4-a468-4747302bce7b]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:21 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 Apr 15 10:19:21 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:21 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-21e7ea6d-63e2-4fd3-8fe6-044d68938bad" returned: 0 in 0.441s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-21e7ea6d-63e2-4fd3-8fe6-044d68938bad" released by "delete_volume" :: held 1.990s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Created reservations ['a4d81837-46bb-4798-9387-83ce24d11554', '989195ba-395d-4ddb-8141-bedcce3b408f', '207a8c98-53b9-45e2-9c35-dbc8dcccd695', '6b7566fd-e5c5-4df2-a575-6399be14bd74'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:21 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:21 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-b3b5326f-43cf-4732-a2ba-2b37f452272d-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-b3b5326f-43cf-4732-a2ba-2b37f452272d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-b3b5326f-43cf-4732-a2ba-2b37f452272d" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-b3b5326f-43cf-4732-a2ba-2b37f452272d" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Deleting offline snapshot b3b5326f-43cf-4732-a2ba-2b37f452272d of volume 7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] snapshot_file for this snap is: volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc2397-44f0-46c7-8489-2310b2d9b95e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:21 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d Apr 15 10:19:21 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:21 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9" returned: 0 in 0.645s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:19:21 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Converted 1024.00 MB image at 457.64 MB/s Apr 15 10:19:21 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 is being set with open permissions: ugo+rw Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:21 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 Apr 15 10:19:21 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:21 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.442s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:21 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Deleted volume successfully. Apr 15 10:19:21 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-187b309e-e9b2-4f43-afca-d4fd785c91eb tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-21e7ea6d-63e2-4fd3-8fe6-044d68938bad-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:22 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d" returned: 0 in 0.522s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[79426481-8005-49b7-ac70-90e4a98fc0d9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:22 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89" returned: 0 in 0.457s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6e0085b7-e227-4504-a88a-ba4430489c89" released by "_copy_volume_from_snapshot" :: held 4.427s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6d5a645b-79a5-47d5-a3e5-c67360534876-6e0085b7-e227-4504-a88a-ba4430489c89" released by "_create_volume_from_snapshot" :: held 4.454s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.496s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.918s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-589756432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a6e359-72ad-4bca-afe8-95b25356e790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:16Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Creating volume f7a6e359-72ad-4bca-afe8-95b25356e790 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:22 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:22 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a Apr 15 10:19:22 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 1073741824 Apr 15 10:19:22 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:22 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bc77b5-06b4-45d6-bc43-53d517706df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0085b7-e227-4504-a88a-ba4430489c89', 'volume_size': 1, 'snapshot_id': '6d5a645b-79a5-47d5-a3e5-c67360534876'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ba86a7-e673-468c-8e26-e62af68c76e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:22 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Volume volume-6e0085b7-e227-4504-a88a-ba4430489c89 (6e0085b7-e227-4504-a88a-ba4430489c89): created successfully Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ba86a7-e673-468c-8e26-e62af68c76e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Flow 'volume_create_manager' (aaac3e27-5316-4fb9-bc93-fba6c144e2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:22 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fb550551-6a6e-4cf1-87a8-23d18c6f7dcb tempest-SnapshotDependencyTests-134055878 None] Created volume successfully. Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-6d5a645b-79a5-47d5-a3e5-c67360534876-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-6d5a645b-79a5-47d5-a3e5-c67360534876-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-quobyte-0f245087-4f6a-44a2-9c2f-f34b94367ab9" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-0f245087-4f6a-44a2-9c2f-f34b94367ab9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-quobyte-6d5a645b-79a5-47d5-a3e5-c67360534876" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6d5a645b-79a5-47d5-a3e5-c67360534876" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Deleting offline snapshot 6d5a645b-79a5-47d5-a3e5-c67360534876 of volume 0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] snapshot_file for this snap is: volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[d401b014-6b26-4312-8790-69f3a4950a51]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:22 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 Apr 15 10:19:22 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:22 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" returned: 0 in 0.488s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:22 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d Apr 15 10:19:22 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:22 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 1073741824" returned: 0 in 0.548s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:22 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:22 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 Apr 15 10:19:22 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:23 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876" returned: 0 in 0.479s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a8605d-0808-4a30-9833-cdbf5c90f791]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:23 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 Apr 15 10:19:23 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:23 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d" returned: 0 in 0.486s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:23 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d Apr 15 10:19:23 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:23 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.761s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556664922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e3c05e-c7f3-4581-894c-bc5ca85c496b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:16Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Creating volume 19e3c05e-c7f3-4581-894c-bc5ca85c496b {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:23 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ac72b7-5d4e-4fbf-aa6e-74eb461d172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a6e359-72ad-4bca-afe8-95b25356e790', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:23 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b 1073741824 Apr 15 10:19:23 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f070c1-30d7-4403-a36b-1d69d5d28e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:23 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume volume-f7a6e359-72ad-4bca-afe8-95b25356e790 (f7a6e359-72ad-4bca-afe8-95b25356e790): created successfully Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f070c1-30d7-4403-a36b-1d69d5d28e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (f7ba6592-68a3-43e5-b273-b0fbb9133bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f94720dd-cf89-4d9c-a611-a028098b5774 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created volume successfully. Apr 15 10:19:23 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9" returned: 0 in 0.497s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:23 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 Apr 15 10:19:23 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:23 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a.b3b5326f-43cf-4732-a2ba-2b37f452272d" returned: 0 in 0.454s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-b3b5326f-43cf-4732-a2ba-2b37f452272d" released by "_delete_snapshot" :: held 2.010s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" released by "delete_snapshot" :: held 2.021s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Created reservations ['c1ea5cfb-7b47-4e7a-904d-914fc183683e', '45be4b4d-4177-4005-813e-d6fce31cc328', '8ec12319-a3db-4e73-bf2e-7448b1f19bad', '8ddf1369-9534-4cd5-a312-0c084d785015'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:23 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Delete snapshot completed successfully. Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fb8836e0-32a2-40fd-949c-6155ad4923fd tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-b3b5326f-43cf-4732-a2ba-2b37f452272d-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:23 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b 1073741824" returned: 0 in 0.515s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:23 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b Apr 15 10:19:23 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:23 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876" returned: 0 in 0.467s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:23 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:24 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876 Apr 15 10:19:24 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:24 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b" returned: 0 in 0.438s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.452s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601971512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73214d6-b9b8-43be-ba36-0a50328c5252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:17Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Creating volume b73214d6-b9b8-43be-ba36-0a50328c5252 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:24 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069af2a7-ae66-49d4-99cb-c7614edcf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:24 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 1073741824 Apr 15 10:19:24 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbe08b6-c2aa-4a5b-96ae-4f6d2bd702ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:24 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b (19e3c05e-c7f3-4581-894c-bc5ca85c496b): created successfully Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbe08b6-c2aa-4a5b-96ae-4f6d2bd702ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (3b763d17-7991-4cfa-855f-42dfa6849c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0fcd0698-5eb9-4e0c-b058-f0d319eb839d tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created volume successfully. Apr 15 10:19:24 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9.6d5a645b-79a5-47d5-a3e5-c67360534876" returned: 0 in 0.434s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6d5a645b-79a5-47d5-a3e5-c67360534876" released by "_delete_snapshot" :: held 1.932s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-0f245087-4f6a-44a2-9c2f-f34b94367ab9" released by "delete_snapshot" :: held 1.945s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Created reservations ['823e93d9-291d-4643-8312-ba0c65c6325e', 'fa96f767-3896-409f-b75c-f51d8f385c20', '23f10e6c-c9ca-4162-94c0-93d098812777', '77db4d20-4a62-4fda-8eb6-3c0e18ef3fb2'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:24 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Delete snapshot completed successfully. Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-5580ffa6-cffe-4c17-90a8-8e5348b672b9 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-6d5a645b-79a5-47d5-a3e5-c67360534876-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-0f245087-4f6a-44a2-9c2f-f34b94367ab9-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-0f245087-4f6a-44a2-9c2f-f34b94367ab9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-quobyte-0f245087-4f6a-44a2-9c2f-f34b94367ab9" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-0f245087-4f6a-44a2-9c2f-f34b94367ab9" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa47337-b141-4368-9405-58807ccf55e4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:24 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 Apr 15 10:19:24 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "cinder-quobyte-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d5732-6eac-43c6-8ff0-8571081a868c]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:24 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 1073741824" returned: 0 in 0.587s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:24 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:24 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 Apr 15 10:19:24 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:24 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a Apr 15 10:19:24 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:25 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9" returned: 0 in 0.548s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:25 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9 Apr 15 10:19:25 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:25 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.402s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1437380093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf9dc4d-4919-43e9-bf13-fb190f949386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c732de389584371a67cf8d73bf1ce3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:17Z,use_quota=True,user_id='72ad5e8c3e9e41339c9bf44563fac72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Creating volume 2bf9dc4d-4919-43e9-bf13-fb190f949386 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:25 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:25 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6cb02-53bd-4e98-ab66-ba574bd0c6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73214d6-b9b8-43be-ba36-0a50328c5252', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef1d0f6-1d5e-4087-954c-80f6e2a9d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:25 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 1073741824 Apr 15 10:19:25 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" returned: 0 in 0.560s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:25 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume volume-b73214d6-b9b8-43be-ba36-0a50328c5252 (b73214d6-b9b8-43be-ba36-0a50328c5252): created successfully Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef1d0f6-1d5e-4087-954c-80f6e2a9d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (4c5d49b2-5edd-481e-8533-7717dd27ac76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:25 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-cca7acc8-4337-459b-a1c9-b07a1fcc7e91 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created volume successfully. Apr 15 10:19:25 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a Apr 15 10:19:25 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:25 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-0f245087-4f6a-44a2-9c2f-f34b94367ab9" returned: 0 in 0.431s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-0f245087-4f6a-44a2-9c2f-f34b94367ab9" released by "delete_volume" :: held 1.007s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Created reservations ['dbe9c510-ddf5-4dbc-8465-8747f4eadf97', '951fb529-8228-43fe-b75c-ed44e28a75d4', 'cc8d1ee8-8cbb-4551-8f98-bc1dc740a9f1', 'a9da8519-6d04-45ff-8159-fa51c4ce0320'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:25 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:25 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:25 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" returned: 0 in 0.517s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-quobyte-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a" released by "delete_volume" :: held 1.106s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:25 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 1073741824" returned: 0 in 0.579s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:25 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Created reservations ['7dcd12c3-221d-4d7f-a00c-446fbe843bf5', 'a23154d7-614e-4e78-a1df-65110e6ef578', '477f303b-ecee-422b-bf01-7f4dd4db2ff7', 'd332b6db-4b75-4d6d-a5fc-60494996c690'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:26 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 Apr 15 10:19:26 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:26 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:26 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:26 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.462s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Deleted volume successfully. Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-1cc6c199-d971-4448-9f71-fcda46c14a03 tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-0f245087-4f6a-44a2-9c2f-f34b94367ab9-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:26 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386" returned: 0 in 0.461s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:26 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.530s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:26 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Cloning volume 76068778-28cc-4f3b-9761-aee6a0b34cf8 to volume 4893db7c-5c54-4f14-b89a-4d35506195d3 Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfd6a83-5cf9-45fc-bbd5-4baffbcc57a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf9dc4d-4919-43e9-bf13-fb190f949386', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4819bf7b-0a6a-4830-9b7c-dcb17f89c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Deleted volume successfully. Apr 15 10:19:26 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Volume volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 (2bf9dc4d-4919-43e9-bf13-fb190f949386): created successfully Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4819bf7b-0a6a-4830-9b7c-dcb17f89c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Flow 'volume_create_manager' (ebd3f05c-4890-4fab-9ad2-1231d5df1729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Creating offline snapshot df351cc3-2e87-4fb8-a274-1e0d3c965257 of volume 76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:19:26 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-f5fd3a3b-5823-4e3c-bf95-2f44785ff06e tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created volume successfully. Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87770c6-300f-4073-ac65-306dfccc19fb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-f43999d4-d35b-45d5-b9cb-3c8ffb78b021 tempest-CreateVolumesFromSnapshotTest-213222752 None] Lock "cinder-7a7d2324-636d-4e0f-b961-5e0a4f1ad17a-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:26 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 Apr 15 10:19:26 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-2bf9dc4d-4919-43e9-bf13-fb190f949386-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-2bf9dc4d-4919-43e9-bf13-fb190f949386-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-quobyte-2bf9dc4d-4919-43e9-bf13-fb190f949386" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-2bf9dc4d-4919-43e9-bf13-fb190f949386" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc5bbe4-87d4-4518-a9cf-033d66cf1e07]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:26 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 Apr 15 10:19:26 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-6e0085b7-e227-4504-a88a-ba4430489c89-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-6e0085b7-e227-4504-a88a-ba4430489c89-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "cinder-quobyte-6e0085b7-e227-4504-a88a-ba4430489c89" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6e0085b7-e227-4504-a88a-ba4430489c89" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49ef027-08cc-43f2-8685-03d1109470a1]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:26 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:26 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 Apr 15 10:19:26 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:27 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8" returned: 0 in 0.627s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:27 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 1G Apr 15 10:19:27 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:27 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386" returned: 0 in 0.568s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:27 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386 Apr 15 10:19:27 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:27 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89" returned: 0 in 0.647s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:27 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89 Apr 15 10:19:27 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:27 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 1G" returned: 0 in 0.646s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:27 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 Apr 15 10:19:27 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:27 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-2bf9dc4d-4919-43e9-bf13-fb190f949386" returned: 0 in 0.583s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-2bf9dc4d-4919-43e9-bf13-fb190f949386" released by "delete_volume" :: held 1.184s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created reservations ['84b03c78-20e5-43c5-9c88-1773bf890847', '736dc593-83dd-40d6-a505-06e1b4a1d157', 'c4f84f74-3d23-4310-9090-b716a89ff294', 'e7521fd9-ee68-4f7d-9b1b-907ab5004172'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:27 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:27 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:27 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:28 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-6e0085b7-e227-4504-a88a-ba4430489c89" returned: 0 in 0.553s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-quobyte-6e0085b7-e227-4504-a88a-ba4430489c89" released by "delete_volume" :: held 1.222s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Created reservations ['b749b6c0-7d72-498c-8747-55e1824ef034', '5e86af1a-2888-4376-9013-f163a00a3a5a', '74fa1859-3182-4889-82e1-8116f0e46a8c', 'be7613a2-5f69-4c22-b21c-c8ce5a68c428'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:28 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:28 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:28 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257" returned: 0 in 0.520s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:28 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 is being set with open permissions: ugo+rw Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:28 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 Apr 15 10:19:28 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:28 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.517s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Deleted volume successfully. Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-d28e0407-434a-4d67-a47b-a1c2ba28e2f1 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-2bf9dc4d-4919-43e9-bf13-fb190f949386-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:28 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.511s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:28 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Deleted volume successfully. Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-280b1c47-330f-4da4-8960-f3c4ac52668e tempest-SnapshotDependencyTests-134055878 None] Lock "cinder-6e0085b7-e227-4504-a88a-ba4430489c89-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:28 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257" returned: 0 in 0.458s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:28 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.info Apr 15 10:19:28 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-b73214d6-b9b8-43be-ba36-0a50328c5252-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-b73214d6-b9b8-43be-ba36-0a50328c5252-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Flow 'volume_create_manager' (b2a95898-e01c-43b8-b70a-0f0aa79bbc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08477ed2-d457-4cb2-9d42-d948e084c3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08477ed2-d457-4cb2-9d42-d948e084c3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab6ca788e584206b2d7a43aed5b8abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:29Z,use_quota=True,user_id='af43b03e4d124242828fd34a54fac5ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654ccc9e-0ff5-4f1f-8526-5c7741ea5b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654ccc9e-0ff5-4f1f-8526-5c7741ea5b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291e2b7f-8981-4d63-a22c-dcc9d6645f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291e2b7f-8981-4d63-a22c-dcc9d6645f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6', 'volume_name': 'volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117ab03e-a00b-4407-9b7c-79b2632182b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117ab03e-a00b-4407-9b7c-79b2632182b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3b970a-9edd-431e-8320-cd05a83e926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:28 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Volume adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6', 'volume_size': 1} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-quobyte-b73214d6-b9b8-43be-ba36-0a50328c5252" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-b73214d6-b9b8-43be-ba36-0a50328c5252" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5544fd7-a98a-4b76-8cdb-a838e23cb8a4]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:28 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:29 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 Apr 15 10:19:29 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:29 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.info" returned: 0 in 0.463s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:29 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.info is being set with open permissions: ugo+rw Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:29 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.info Apr 15 10:19:29 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:29 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252" returned: 0 in 0.565s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:29 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252 Apr 15 10:19:29 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:29 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.info" returned: 0 in 0.501s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-4893db7c-5c54-4f14-b89a-4d35506195d3" by "_copy_volume_from_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-4893db7c-5c54-4f14-b89a-4d35506195d3" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] snapshot: df351cc3-2e87-4fb8-a274-1e0d3c965257, volume: 4893db7c-5c54-4f14-b89a-4d35506195d3, {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[07871dcf-01d9-4b0f-994e-039840bfb780]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:29 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:29 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 Apr 15 10:19:29 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:29 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-b73214d6-b9b8-43be-ba36-0a50328c5252" returned: 0 in 0.437s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-b73214d6-b9b8-43be-ba36-0a50328c5252" released by "delete_volume" :: held 1.027s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created reservations ['056c4017-16ab-4a54-9d0a-6949f09fcff9', '9d587258-e057-4c0b-8199-be616a11e9b5', '88ee2243-bdf2-402a-8a04-9330ffe6875d', '3eb2ed9b-eb65-40cf-8c74-7dd879c61737'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:30 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:30 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:30 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257" returned: 0 in 0.534s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76068778-28cc-4f3b-9761-aee6a0b34cf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Creating direct copy from snapshot {{(pid=82850) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[8686aacc-106f-4c0c-97d2-6882d131c183]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:30 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 Apr 15 10:19:30 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:30 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.498s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:30 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Deleted volume successfully. Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-faac32b5-2328-4db1-8c5a-7f42b4b52ed5 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-b73214d6-b9b8-43be-ba36-0a50328c5252-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:30 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8" returned: 0 in 0.494s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG cinder.utils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Path /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 not found in is_blk_device check {{(pid=82850) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:19:30 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:30 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 Apr 15 10:19:30 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-19e3c05e-c7f3-4581-894c-bc5ca85c496b-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-19e3c05e-c7f3-4581-894c-bc5ca85c496b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-quobyte-19e3c05e-c7f3-4581-894c-bc5ca85c496b" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:31 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-19e3c05e-c7f3-4581-894c-bc5ca85c496b" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:31 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a77ce49-21a0-440e-8c81-f81e90d98430]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:31 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:31 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b Apr 15 10:19:31 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:32 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b" returned: 0 in 1.306s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:32 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:32 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b Apr 15 10:19:32 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:33 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-19e3c05e-c7f3-4581-894c-bc5ca85c496b" returned: 0 in 0.867s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-19e3c05e-c7f3-4581-894c-bc5ca85c496b" released by "delete_volume" :: held 2.212s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_service.periodic_task [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82850) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:33 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:33 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created reservations ['c2ea23b9-2e1e-4037-a5d4-6012c02a4faf', '9c12153f-e883-4862-91e4-1cbef4c62fcd', '51645a12-755b-46c3-9118-933deb7d0c0f', 'a0981f12-aafd-47c5-8c50-18c3ffb93138'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:33 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3" returned: 0 in 2.610s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ae902a-3019-43ce-a59c-2aecd07b81b5]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:33 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:33 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:33 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 Apr 15 10:19:33 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:33 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.496s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2e9d4c12-2660-4456-80db-879c646ce2a6 None None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:33 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.448s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:33 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Deleted volume successfully. Apr 15 10:19:33 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-afa41e7c-a6df-490f-8dab-0776aae75b3a tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-19e3c05e-c7f3-4581-894c-bc5ca85c496b-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:34 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8" returned: 0 in 0.700s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.image.image_utils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Image conversion details: src /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8, size 1024.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 {{(pid=82850) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:19:34 devstack cinder-volume[82850]: INFO cinder.image.image_utils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Converted 1024.00 MB image at 391.96 MB/s Apr 15 10:19:34 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 is being set with open permissions: ugo+rw Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:34 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 Apr 15 10:19:34 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-f7a6e359-72ad-4bca-afe8-95b25356e790-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-f7a6e359-72ad-4bca-afe8-95b25356e790-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-quobyte-f7a6e359-72ad-4bca-afe8-95b25356e790" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-f7a6e359-72ad-4bca-afe8-95b25356e790" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7f76f0-23f2-428c-b56d-9deee581f267]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:34 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 Apr 15 10:19:34 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:34 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-4893db7c-5c54-4f14-b89a-4d35506195d3" released by "_copy_volume_from_snapshot" :: held 4.873s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-df351cc3-2e87-4fb8-a274-1e0d3c965257" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-df351cc3-2e87-4fb8-a274-1e0d3c965257" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Deleting offline snapshot df351cc3-2e87-4fb8-a274-1e0d3c965257 of volume 76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] snapshot_file for this snap is: volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[074616c3-7200-4b3e-8387-01a77af924f9]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:34 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:34 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 Apr 15 10:19:34 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:35 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790" returned: 0 in 0.510s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:35 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790 Apr 15 10:19:35 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:35 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257" returned: 0 in 0.531s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76068778-28cc-4f3b-9761-aee6a0b34cf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[a659f5f6-d475-4c08-a122-0801da3dce3e]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:35 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 Apr 15 10:19:35 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:35 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-f7a6e359-72ad-4bca-afe8-95b25356e790" returned: 0 in 0.474s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-f7a6e359-72ad-4bca-afe8-95b25356e790" released by "delete_volume" :: held 1.034s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created reservations ['72ae7cf4-1f3c-413f-9900-27a03cdd8d40', '0e8f9d99-dbf6-4655-aa89-480b93311df4', 'fbfcadee-05dd-4baf-8198-d381970251c0', '6de88569-37f9-4a9b-841b-8419718972b3'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:35 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:35 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:35 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8" returned: 0 in 0.558s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:35 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:35 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 Apr 15 10:19:35 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:36 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.579s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:36 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Deleted volume successfully. Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-814b2b73-c3f6-49aa-89d4-c33dcadbd601 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-f7a6e359-72ad-4bca-afe8-95b25356e790-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:36 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257" returned: 0 in 0.604s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:36 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257 Apr 15 10:19:36 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-1ce63d98-2ad1-47d4-abc8-f288060ba7f0-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-1ce63d98-2ad1-47d4-abc8-f288060ba7f0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-quobyte-1ce63d98-2ad1-47d4-abc8-f288060ba7f0" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-1ce63d98-2ad1-47d4-abc8-f288060ba7f0" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a161a9-e5f9-4d7f-8cd8-2bd861302d98]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:36 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 Apr 15 10:19:36 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:36 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8.df351cc3-2e87-4fb8-a274-1e0d3c965257" returned: 0 in 0.492s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-df351cc3-2e87-4fb8-a274-1e0d3c965257" released by "_delete_snapshot" :: held 2.235s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.468s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.981s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab6ca788e584206b2d7a43aed5b8abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:29Z,use_quota=True,user_id='af43b03e4d124242828fd34a54fac5ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Creating volume adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:36 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:36 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 1073741824 Apr 15 10:19:36 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4a2747-9c0b-4240-b70a-fcfb3220bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4893db7c-5c54-4f14-b89a-4d35506195d3', 'volume_size': 1, 'source_volid': '76068778-28cc-4f3b-9761-aee6a0b34cf8', 'source_volstatus': 'available'}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:36 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fd80aa-882b-4541-b7d9-5c36b7b8b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:37 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Volume volume-4893db7c-5c54-4f14-b89a-4d35506195d3 (4893db7c-5c54-4f14-b89a-4d35506195d3): created successfully Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fd80aa-882b-4541-b7d9-5c36b7b8b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Flow 'volume_create_manager' (b9c91236-5b3b-43a2-b02d-a9cdd7ed46bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:37 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3d6f0c03-7eae-4e18-bf23-f100b60e9373 tempest-VolumeDependencyTests-1512334694 None] Created volume successfully. Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-76068778-28cc-4f3b-9761-aee6a0b34cf8-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-76068778-28cc-4f3b-9761-aee6a0b34cf8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-76068778-28cc-4f3b-9761-aee6a0b34cf8" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-76068778-28cc-4f3b-9761-aee6a0b34cf8" acquired by "delete_volume" :: waited 0.020s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e4194-1e8f-4857-b61a-c4ceee4a7564]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:37 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 Apr 15 10:19:37 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:37 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0" returned: 0 in 0.760s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:37 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0 Apr 15 10:19:37 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:37 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 1073741824" returned: 0 in 0.666s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:37 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:37 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 Apr 15 10:19:37 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:38 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8" returned: 0 in 0.712s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:38 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-1ce63d98-2ad1-47d4-abc8-f288060ba7f0" returned: 0 in 0.559s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-1ce63d98-2ad1-47d4-abc8-f288060ba7f0" released by "delete_volume" :: held 1.349s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:38 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8 Apr 15 10:19:38 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created reservations ['ac3436a2-501a-4587-897b-7f59ca396dac', 'ef0bd921-2166-4b3f-9862-af6e7bee46e5', '23955061-8b22-4c46-8a9f-16fd097a84d7', 'd1823141-abe5-4859-821c-e844bb83ca8f'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:38 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:38 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:38 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6" returned: 0 in 0.526s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3b970a-9edd-431e-8320-cd05a83e926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c77387-e5f8-49a6-97d9-07ebbf0bf852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Volume volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 (adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6): created successfully Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c77387-e5f8-49a6-97d9-07ebbf0bf852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Flow 'volume_create_manager' (b2a95898-e01c-43b8-b70a-0f0aa79bbc9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-9eaf347e-219c-4124-8455-2355621ca7f6 tempest-CinderUnicodeTest-1980033566 None] Created volume successfully. Apr 15 10:19:38 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-76068778-28cc-4f3b-9761-aee6a0b34cf8" returned: 0 in 0.474s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-76068778-28cc-4f3b-9761-aee6a0b34cf8" released by "delete_volume" :: held 1.230s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Created reservations ['74a10bd2-b856-4574-9ef0-60cd634c1700', '9c6b7dbc-c1ce-416a-b33d-5d8ebfaeb96c', '2ddff8a3-7965-4fce-b52f-a97e90308b45', 'be2ad406-3c47-4c59-ae4a-75a53f7d03cb'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:38 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.440s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:38 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Deleted volume successfully. Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-4ddabb33-7ddd-4dbe-a6a2-9b4aeaaeb792 tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-1ce63d98-2ad1-47d4-abc8-f288060ba7f0-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:38 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:38 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-32bf7740-70e2-4d33-be1e-c42e44d93ffd-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-32bf7740-70e2-4d33-be1e-c42e44d93ffd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "cinder-quobyte-32bf7740-70e2-4d33-be1e-c42e44d93ffd" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-32bf7740-70e2-4d33-be1e-c42e44d93ffd" acquired by "delete_volume" :: waited 0.010s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c57da9f-062c-4d10-9802-fa7e81f8b219]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82850) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Flow 'volume_create_manager' (f0eafecc-81a0-42fc-9ab5-843cbb32551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ff228e-d49f-4e88-b61e-01028337389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ff228e-d49f-4e88-b61e-01028337389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-163247801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6e74ef-4892-480e-bcd0-54ed0c0d9c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab6ca788e584206b2d7a43aed5b8abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:39Z,use_quota=True,user_id='af43b03e4d124242828fd34a54fac5ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d299ae0b-7cd5-4f5c-9b60-bd4e11630914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d299ae0b-7cd5-4f5c-9b60-bd4e11630914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be860bb2-e828-4085-a0af-ec80eb9fb86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:38 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd Apr 15 10:19:38 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be860bb2-e828-4085-a0af-ec80eb9fb86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6e74ef-4892-480e-bcd0-54ed0c0d9c28', 'volume_name': 'volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8135db98-d014-4124-aa14-bec3f66e6f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8135db98-d014-4124-aa14-bec3f66e6f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98be6de2-40a8-4be2-8a3d-a25f8e24fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:38 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Volume 4e6e74ef-4892-480e-bcd0-54ed0c0d9c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28', 'volume_size': 1} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:19:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-163247801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6e74ef-4892-480e-bcd0-54ed0c0d9c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ab6ca788e584206b2d7a43aed5b8abd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:19:39Z,use_quota=True,user_id='af43b03e4d124242828fd34a54fac5ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7cebfd4-47f3-44df-b636-f29525a43041),volume_type_id=d7cebfd4-47f3-44df-b636-f29525a43041)}" {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Creating volume 4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Selected osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 as target Quobyte volume. {{(pid=82850) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:19:38 devstack cinder-volume[82850]: INFO cinder.volume.drivers.remotefs [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] casted to osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383 Apr 15 10:19:38 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 1073741824 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:39 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 1073741824 Apr 15 10:19:39 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:39 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.440s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:39 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Deleted volume successfully. Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-ad6ab230-2e9a-49d4-9a10-8d575a3d97b0 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-76068778-28cc-4f3b-9761-aee6a0b34cf8-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-4893db7c-5c54-4f14-b89a-4d35506195d3-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-4893db7c-5c54-4f14-b89a-4d35506195d3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-4893db7c-5c54-4f14-b89a-4d35506195d3" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-4893db7c-5c54-4f14-b89a-4d35506195d3" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff4a361-cf50-46d9-a67b-760a25f11de6]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:39 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd" returned: 0 in 0.551s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:39 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd Apr 15 10:19:39 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:39 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 Apr 15 10:19:39 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:39 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 1073741824" returned: 0 in 0.538s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:39 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 Apr 15 10:19:39 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:39 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3" returned: 0 in 0.474s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:39 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3 Apr 15 10:19:39 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:39 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-32bf7740-70e2-4d33-be1e-c42e44d93ffd" returned: 0 in 0.495s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-quobyte-32bf7740-70e2-4d33-be1e-c42e44d93ffd" released by "delete_volume" :: held 1.079s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:39 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Created reservations ['2ee2b9b5-5503-4424-81e0-fad0b2e07403', 'cfae61ba-06e0-4120-9a83-e5fefb284715', 'badffe2c-1d7c-441f-b481-b210c37a60ba', '81dc38d0-6dc2-4a1e-8458-9fd142390f4d'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:40 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" returned: 0 in 0.468s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'} {{(pid=82850) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98be6de2-40a8-4be2-8a3d-a25f8e24fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28', 'volume_size': 1}' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ecc330-09b5-4fd4-a78f-239038f34ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:19:40 devstack cinder-volume[82850]: INFO cinder.volume.flows.manager.create_volume [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Volume volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 (4e6e74ef-4892-480e-bcd0-54ed0c0d9c28): created successfully Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ecc330-09b5-4fd4-a78f-239038f34ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82850) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Flow 'volume_create_manager' (f0eafecc-81a0-42fc-9ab5-843cbb32551a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82850) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:19:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-a7f1e874-9d43-4caa-ae3d-98aa4a442584 tempest-CinderUnicodeTest-1980033566 None] Created volume successfully. Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:40 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:40 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:40 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4893db7c-5c54-4f14-b89a-4d35506195d3" returned: 0 in 0.409s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-4893db7c-5c54-4f14-b89a-4d35506195d3" released by "delete_volume" :: held 0.906s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Created reservations ['86b1c601-179e-404b-9f19-ca71d8fd5642', 'cda8356b-b1fb-4ffb-a61a-1a03f9101dd1', '51a406ab-4f18-439c-b95f-df1e8a96a207', '9428b22b-4b0e-4081-aa2a-8815362025e2'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:40 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:40 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-d5c3a518-52cd-471b-9842-3b21458e1063-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:40 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.464s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Deleted volume successfully. Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-d5c3a518-52cd-471b-9842-3b21458e1063-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-3e22805d-dd18-4f76-883a-5ee2fb2c3dca tempest-CreateVolumesFromSourceVolumeTest-525908920 None] Lock "cinder-32bf7740-70e2-4d33-be1e-c42e44d93ffd-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "cinder-quobyte-d5c3a518-52cd-471b-9842-3b21458e1063" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-d5c3a518-52cd-471b-9842-3b21458e1063" acquired by "delete_volume" :: waited 0.007s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[158b97e2-9217-47cc-9384-72150cc5cccb]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:40 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 Apr 15 10:19:40 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:40 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.428s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:40 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Deleted volume successfully. Apr 15 10:19:40 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-b77333ab-7d6a-4ef7-8ae4-60553746054a tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-4893db7c-5c54-4f14-b89a-4d35506195d3-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:41 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063" returned: 0 in 0.586s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:41 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063 Apr 15 10:19:41 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Creating offline snapshot 7b2a8976-567b-4714-8105-8fd79b05183a of volume 4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[1901e871-30b0-4f6d-8eed-6f2eff6e4449]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:41 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 Apr 15 10:19:41 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:41 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-d5c3a518-52cd-471b-9842-3b21458e1063" returned: 0 in 0.487s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-quobyte-d5c3a518-52cd-471b-9842-3b21458e1063" released by "delete_volume" :: held 1.097s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Created reservations ['8b8a30dd-7f42-4e93-bfa7-aee46cc34e3c', 'dec72794-2afc-4e62-8845-7f1c0f9d8175', 'a0bc04c0-08a1-4419-bd88-f19ffee4f51e', 'a82bbb87-72e3-4999-be17-5d2b1a61bcc6'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:41 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:41 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:41 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" returned: 0 in 0.581s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:41 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a 1G {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:41 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a 1G Apr 15 10:19:41 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:42 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.475s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:42 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:42 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Deleted volume successfully. Apr 15 10:19:42 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-fe138598-3261-4705-9d62-186a6b3291b8 tempest-VolumeDependencyTests-1512334694 None] Lock "cinder-d5c3a518-52cd-471b-9842-3b21458e1063-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:42 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a 1G" returned: 0 in 0.547s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:42 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a Apr 15 10:19:42 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:42 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 -F qcow2 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a" returned: 0 in 0.507s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:42 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a is being set with open permissions: ugo+rw Apr 15 10:19:42 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:42 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a Apr 15 10:19:42 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:43 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a" returned: 0 in 0.478s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:43 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.info Apr 15 10:19:43 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:43 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.info" returned: 0 in 0.480s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:43 devstack cinder-volume[82850]: WARNING cinder.volume.drivers.remotefs [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.info is being set with open permissions: ugo+rw Apr 15 10:19:43 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.info {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:43 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.info Apr 15 10:19:43 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:44 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.info" returned: 0 in 0.459s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:44 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.113s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:44 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-483940c0-1d98-4a3c-a9a2-4168fd35f23e tempest-CinderUnicodeTest-1980033566 None] Create snapshot completed successfully Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "cinder-7b2a8976-567b-4714-8105-8fd79b05183a-delete_snapshot" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-7b2a8976-567b-4714-8105-8fd79b05183a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "cinder-quobyte-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" by "delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "cinder-quobyte-7b2a8976-567b-4714-8105-8fd79b05183a" by "_delete_snapshot" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-7b2a8976-567b-4714-8105-8fd79b05183a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Deleting offline snapshot 7b2a8976-567b-4714-8105-8fd79b05183a of volume 4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] snapshot_file for this snap is: volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a {{(pid=82850) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[704e8998-c596-4784-9647-6e120c6a0709]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:45 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a Apr 15 10:19:45 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:45 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a" returned: 0 in 0.505s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.remotefs [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82850) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eeb884-e414-457a-950e-d29da9066852]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:45 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:46 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 Apr 15 10:19:46 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:46 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" returned: 0 in 0.521s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:46 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a Apr 15 10:19:46 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:46 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a" returned: 0 in 0.471s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:46 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:47 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a Apr 15 10:19:47 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:47 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:47 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28.7b2a8976-567b-4714-8105-8fd79b05183a" returned: 0 in 0.432s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-7b2a8976-567b-4714-8105-8fd79b05183a" released by "_delete_snapshot" :: held 1.986s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" released by "delete_snapshot" :: held 2.000s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:47 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Created reservations ['d750dfc2-218b-46f6-b0f4-9826dee9fad1', '7fa5780f-6282-4dce-83cf-52105ac3307b', '4d2ea120-dc84-437a-9b34-dd7da245c93a', '91cfc219-d2f3-495d-847d-f3d119da5ffe'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:47 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Delete snapshot completed successfully. Apr 15 10:19:47 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-0d83df74-6383-4a95-afd4-da6720bb19f5 tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-7b2a8976-567b-4714-8105-8fd79b05183a-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "cinder-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "cinder-quobyte-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:48 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" acquired by "delete_volume" :: waited 0.008s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:48 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f393d0a-fc95-4b04-8483-4ccd4560e220]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:48 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:48 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 Apr 15 10:19:48 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:49 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" returned: 0 in 0.470s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:49 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28 Apr 15 10:19:49 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:49 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" returned: 0 in 0.411s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28" released by "delete_volume" :: held 0.910s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Created reservations ['bcecc058-8b2c-4940-b32e-e63b4c3b1488', '5897e482-8e82-49f3-b41d-2edc1cc7295d', 'ecc39c69-9fd4-4e49-aa4c-2460c26182e1', '415492c8-b64d-43f9-8650-50568a0fb602'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:49 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:49 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "cinder-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6-delete_volume" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "cinder-quobyte-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6" by "delete_volume" {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6" acquired by "delete_volume" :: waited 0.009s {{(pid=82850) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo.privsep.daemon [-] privsep: reply[82749551-c570-408f-a3be-1509219ea8e3]: (4, 'qcow2') {{(pid=83626) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:19:49 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:49 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 Apr 15 10:19:49 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:50 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.444s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:50 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Deleted volume successfully. Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-312905ed-d89e-4c97-9e63-e428df25946d tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-4e6e74ef-4892-480e-bcd0-54ed0c0d9c28-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:50 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6" returned: 0 in 0.469s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:50 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6 Apr 15 10:19:50 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:50 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637/volume-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6" returned: 0 in 0.425s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-quobyte-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6" released by "delete_volume" :: held 0.917s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG cinder.quota [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Created reservations ['41fc4e3f-8637-4cc3-b0f4-a76a95dce5f4', '3ebb1794-074c-4699-ba12-61fd28308cc0', '47bdb716-f196-4866-8d97-f19f0c091c42', '012803f9-8dd3-44cd-9437-f458b89cbd64'] {{(pid=82850) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383': None} {{(pid=82850) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG cinder.volume.drivers.quobyte [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e27a1751-6f62-45be-8d1c-096ccb2c8383'] {{(pid=82850) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.lockutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82850) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:19:50 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:19:50 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637 Apr 15 10:19:50 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:19:51 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Apr 15 10:19:51 devstack cinder-volume[82850]: DEBUG oslo_concurrency.processutils [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fc426c5427ff4e9a5376eac3b0f7f637" returned: 0 in 0.440s {{(pid=82850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:19:51 devstack cinder-volume[82850]: DEBUG cinder.manager [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Notifying Schedulers of capabilities ... {{(pid=82850) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:19:51 devstack cinder-volume[82850]: INFO cinder.volume.manager [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Deleted volume successfully. Apr 15 10:19:51 devstack cinder-volume[82850]: DEBUG cinder.coordination [None req-2372b39a-38eb-471e-902c-e6df1c3d2a3e tempest-CinderUnicodeTest-1980033566 None] Lock "cinder-adc77e3b-e4cd-49dc-9b59-3cb2e161a3c6-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=82850) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:20:00 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:UPDATE=273,cinder:SELECT=179,cinder:INSERT=61,cinder:DELETE=25 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:20:01 devstack cinder-volume[82850]: DEBUG dbcounter [-] [82850] Writing DB stats cinder:SELECT=203,cinder:INSERT=72,cinder:UPDATE=270,cinder:DELETE=20 {{(pid=82850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}